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This report sunaarizes the evaluation of a national 
conference on "Education and Citizenship; Responsibilities for the 
CoBBon Good" held in Kansas City, Missouri, on September 20-23, 1976. 
Participants were 400 persons who are interested or involved in 
political education. The conference involved speeches and papers froa 
experts and leaders in the field, information dissemination about 
activities in key areas, task-oriented work groups, and improvement 
of the political education system. The report covers participant, 
leader, and evaluation team views of the conference, including 
conclusions, recommendations, evaluation of the Delphi process used 
at the conference, and followup activities. The evaluation format 
used the feedback process of a systems analysis model- Every major 
activitiy was assessed while in action, such as registration, room 
arrangements, major presentations, and work groups. Questionnaires 
obtained information about participant back^e^und, involvement in 
citizen education, views of the conference activities, views of 
conference goals, and suggestions for conference improvement. 
Different questionnaires were used to query participants; 
participants/observers; work group facilitators/host recorders; and 
resource persons/presenters. The Delphi technique was used to seek 
closure on citizen education task definition. The conference was 
evaluated as a success. However, hostilty was expressed toward the 
Delphi process as a time intrusion, whici. is indicative of complaints 
about time constraints, an over structured program, and little 
opportunity for interaction and exchange. Questionnaire return rate 
was 50%, but it was suspected that returns were received only from 
polite, submissive, and contented persons. Appendices contain the 
questionnaires and response data. (ND) 
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PREFACE 



This report stands as an independent evaluation of one segment 
of the long-term and substantial commitment to citizen education which 
the USOE has made in the past and intends for the future. Our con« 
servative estimate of the total costs and expenses of the Kansas 
City conference on "Education and Citizenship" (including speakers' 
fees, travel expenses, hotel rooms, staff and participant time, etc.) 
amounts to some $400,000. Any expenditure of this magnitude from the 
federal treasury in the human services area requires some measure of 
costs and the benefits accruing therefrom. 

The report summarizes the independent evaluation effort of a 
team of external evaluators who were commissioned by the Citizen 
Education Staff of the USOE to provide a separate audit of a major 
and unique national conference on civic, citizen^ and citizenship 
education. This conference brought together some four hundred persona 
who are interested or involved in political education on a formal 
or informal basis. The conference sought to expose this group to 
major speeches and papers presented by experts and exemplary leaders 
in the field. It disseminated information about special activities 
underway in seven key areas (political participation, global perspectives, 
economic, ethnic and multi-cultural, law-related, family, and ethical/ 
moral education). Another conference objective was to encourage 
participants to interact with one another in task-oriented work groups 
and to reach some consensus about the nature of political education. 
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The civic responsibilities of the major sectors (home, labor, 
agriculture, media, business, education, government, religion, and 
voluntary organizations) of American life and how our political 
education system at all levels could be improved (including one's 
personal commitment to the task) now and in the next quarter century 
were also major segments of the meetings. 

Since these were significant objectives, a substantial evaluation 
plan had to be devised to account for them. Consequently, the services 
of two independent evaluators, the authors of this report, were offered 
and accepted by the Citizen Education Staff. The enormity of the uider- 
taking was not readily apparent at first; time estirotes were soon sur- 
passed and even sooner ignored. As one example, we estimate that the 
staff, consultants , and participants spent the equivalent of four full- 
time months of work by one person in preparing, reviewing, reproducing, 
distributing, completing,, collecting, processing, tabulating, inter- 
preting, and reporting these evaluation results. Therefore, we 
believe that this evaluation effort was aa thorough as available time 
and resources could provide, given the present limits of technology 
in this surprisingly little worked field of co^^et^ince evaluation. 

At this point in introducing this report, ft would like to 
recogiize the valuable assistance provided by Mr. Logan Sallada, 
Policy Adviser to the Commissioner, and by the USOE Citizen Education 
Staff under the direction of Mr. George Lowe. Other members of this 
staff who provided the researchers with their advice or assistance at 
one stage or another were Ms. Elizabeth Farquhar, Ms. Susan Wiener, 
Mr. Mike Smith, Ms. Frances Skane, Ms. Jean Carey, and Ms. Joyce Oiase. 
Ms. Theresa Baker of Madison College typed the entire report in record time. 
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Additionally, the other members of our on-site evaluation team in 
Kansas City provided us with valuable insights into how best to implement 
the project there while assisting in the conference evaluation it- 
self. These co-evaluators were Dr. Badi Foster of Harvard University, 
Cambridge, Massachusetts; Dr. Harrison Fox of the U.S. Senate Committee 
on Committees Staff, Washington, D. C; Mr. David Roe, Office of the 
Secretary of HEW in Washington, D. C. ; Mr. Glenn Kamber, Department 
of HEW, Washington, D. C. ; and Dr. Eric Mondschein, USOE, Washington, 
D. C. (Dr. Foster and Dr. Fox had both served on the advisory committee 
for the conference.) Without their assistance, it would not have 
been possible to sample the work groip and special activity sessions 
or to obtain multiple viewpoints on coiranon experiences such as the 
formal presentations. 

Throughout the report, we have attempted to be as objective and 
bias-free as possible in the measurement design, the survey, and inter- 
pretations of our findings. Of course, some errors in judgment and 
unconscious inaccuracies always seem to find their way into any written 
report. We assume full responsibility for any such defects. Further, 
we request the reader to point them out as discovered, so that we 
may learn from our mistakes and improve our performance in the future. 



Russell F. Famen, Jr. 
Harrisonburg, Virginia 



Mansfield I. Smith 
Fairfax, Virginia 



I. INTRODUCTION TO THE STUDY 



This report presents the results of an independent evaluation of 
events leading up to and occurring during a national conference on 
"Education and Citizenship: Responsibilities for the Common Good" 
at Kansas City, Missouri from September 20-23, 1976. This conference 
was held under the joint sponsorship of the Council of Chief State 
School Officers (CCSO)and the U.S. Office of Education (USOE) 
(specifically, the Kansas City Region VII Office and the USOE Citizen 
Education Staff, a part of the Office of the Commissioner in Washington, 
D. C). 

The Conference Evaluation Model 

The conference evaluation format utilized in this study was a 
simple systems analysis model (inputs, throughputs, outputs — feectoack 
process). The researchers attenpted to learn as much about the con- 
ference prior to Kansas City as possible (i.e inputs such as conference 
objectives, participant selection procedures, conference organiza- 
tion, etc.). In preparation for the conference itself, an ongoing 
process-oriented evaluation scheme was designed to obtain perceptions 
on the conference from the perspectives of the participcnta, the 
conference leaders, and an evaluation team of participant-observers. 
Every major activity of the conference while in action (throughputs) 
was assessed, from registration and rooms to food and receptions and 
from major presentations to workgroups and special activities. Little 
happened publicly at the conference that the evaluators were not 
cognizant of sooner or later. The on-site evaluation was as thorough 
as resources, human energy, and ingenuity could produce within a 
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limited time frame. 

The Content of the Conference Evaluation Forms 

The general report on this conference summarizes information ob- 
tained from a series of standardized questionnaires, namely; 

1. Participant's Questionnaire Form #1, Part A, comprising 
108 machine-scored questions with two to five choices for 
each question. The questions covered individual background; 
views on educational innovation; conference application pro- 
ceedings (questions 1-34); participant's evaluation of meeting 
site; facilities and general arrangements (questions 35-65); 
participant's evaluation of the inputs and impact (outputs) of 
the meeting (questions 66-84); and the participant's eval- 
uation of the teaching- learning environment (throughputs) for 
the meeting (questions 83-108). 

2. Participant's Questionnaire, form #1, Part B, an open-ended 
questionnaire of 27 items regarding the objectives of the 
conference, strong and weak points, suggestions for improve- 
ment, and inpact of the meeting on proposed or future activities 
(outputs) in citizen education. In addition, separate open«« 
ended questionnaires were prepared to assess other segments 

of the meeting; namely: 

3. A Participant/Observer's Questionnaire, Form #2, "utilized by 
the seven members of the conference evaluation team for 

\ nearly all principal events — some thirteen major presentations, 

seven work group sessions, and twenty-eight special activities 
sessions; 
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4. A Work Groip Facilitator's/Host Recorder's Questionnaire, 
Forfii #3 and 

5. A Resource Person's/Presenter's Questionnaire, Form #4. 

The Evalu ation Team's Activities at the Conference 

As can be seen from the previously described format, the con- 
ference was critically examined from the point of view of the partici- 
pants and the leaders of the conference. This, in addition to the 
presence of the evaluation team at all major presentations, almost 
all special activity sessions, and one-third of the work group sessions, 
allowed for nearly total coverage of the conference. The evaluation 
team members also observed and experienced all of the minor elements 
of the conference, such as registration proceedings, meeting room 
ambience, and public social interactions, while recording and evaluating 
group reactions to the conference at first hand. 

No formal evaluation scheme could assess participant reactions 
to the frequent patriotic and religious rituals as well as personal 
observation rf those reactions. The same was true in assessing the 
extent to which the conference pamphlet containing citizenship , 
education objectives of the CCSO was igiored by participants, as 
was the lengthy resource book of readings on citizenship education 
prepared at considerable expense for the conference, but distributed 
only as parUcipants arrived. Similarly, participant reactions 
(rebellion!) to using the Delphi technique, to seek closure on citizen 
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education task definition (what can be done?, sector responsibilities, 
corrective measures, etc J could only be fathomed early in the conference 
through direct observation of these reactions. The evaluation team 
provided immediate feedback to the conference leadership (as did the 
work group facilitators and recorders) regarding group hostility 
toward the Delphi process; but it was allowed to stumble along toward 
an unfulfilled destiny. The conference evaluation model had provided 
for prior, ongoing, and follow-up activity with continual feedback 
but, in the instance of the Delphi process, this information was 
largely ignored by the conference leadership (which seemed tightly 
tied to the highly structured conference format as a whole). The 
Delphi was subsequently left to the work group leaders to handle as 
best they could. 

Some Successes and Inadequacies of the Conference 

The experience of this conference with the Delphi technique is 
only a single, microcosmic exanple of a macrocosmic problem which 
plagued the Kansas City Conference from beginning to end. That is, 
all observers, (participants, leaders, and evaluators) commented 
repeatedly on the strict and crowded time frame, the overstructured 
program, the inability to adjust or modify the format, and other 
restrictive or insensitive features of the conference. Time con- 
straints, overstructuring, being talked at or being told to, and 
having too little opportunity for interaction and exchange were 
reactions heard all too frequently from this group of some 400 leaders 
in citizen education from different sectors of Anierican society. 

10 
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With all this said, however seemingly critical of certain 
segments of the meeting, the Kansas City conference was a qualified / 
success in achieving its objectives, A national conference on citizen 
education, the first ever of such magnitude, was held. Key leaders in 
citizen education met for four days and interacted with one another, 
listened to e^^erts in the field, and made contributions and commitments 
to a national effort in citizen education. Despite some of the pro- 
blems mentioned previously, the participants worked long hours (from 
7:00 a.m. to 10:00 p.m. I) acconplishing about a week. and one-half's 
work in a few days. Despite high attrition rates by the thii'd day 
of the conference, participants stud< to their assigned tasks and 
produced committee reports which (however brief, cryptic or inconplete 
for the most part) provide the interested observer with some indices 
of what citizen education in the United States is, who is responsible 
for the process, when, where, how, and by whom this responsibility 
can be exercised, and partial answers to what the key age groups, 
sectors, goals, objectives, attitudes, skills, behaviors, and knowledges' 
are in this important field of formal and non-formal education. 

The Content of the Evaluation Report 

This report covers six major aspects of the Kansas City conferences, 
namely this introduction, in which we provide the reader with back- 
ground information on citizen education and the first national conference 
(put in the perspective of other USOE sponsored national, regional, 
state and local conferences, workshops, and seminars), a general 

11 
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description of the evaluaticxi procedures, costs of the conference in 
time and money, authorization and goal setting for the conference, 
general and specific objectives and other background information which 
puts tha conference in proper context. We then proceed to the partici- 
pants' views of the conference, describing who the participants were, 
where they came from, what were their backgrounds, what they said, 
what they liked and did not like, and so forth. In this same section 
of the report we discuss the strong and weak points of the conference, 
suggestions for improving other conferences, and other products dnd 
contributions from the parUcipants such as the extent of their ongoing 
commitments to civic, citizenship, and/or citizen education. 

Next in order of presentation the evaluators focus on the leaders' 
views of the conference, again summarizing strengths, weaknesses, 
and suggested irrprovements from their perspectives while generalizing 
about their special evaluation of the conference objectives, the 
presentations, the special activities, the work groups and other major 
facets of the meeting. The next part of this study reports on the 
evaluation team's views of the cor.rereroe, with a day by day, hour by 
hour, blow by blow account of all activities (registration, meals, 
receptions, presentations, special activities, and work groups) 
including some irrpressionistic reactions, and those of other parUcipants 
to the conference mode, substance, and activities. The next two 
segments of the: report. contain a list of conclusions and recommendations 
about the conference including suggested improvements for other con- 
ferences such as a looser conference format, more provision for 
parUcipant feedback, and modifications in the Delphi technique, 

12 
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Finally, we conclude with a diacusalcn of further analyaea and r/ 
follow-if) activitiea, which makea the case for a raore conplete 
statistical analysis of thess results; comparisons of the internal 
and external evaluation results; a follow-i|) contact with conference 
participants' evaluation of conference outputs, such as the Delphi 
results; revisions to the evaluation forms, and built in evaluation 
techniques for other conferences starting with the planning, goal 
cbfirltion, and implementation stages. The report alao contains 
several Appendices which include copies of all evaluation forme 
used at the conference as well as abstracts of participant responses 
to selected key questions from Part B of ths open-ended evaluation 
form. 

Characteristics of Re spondents to the questionnaires and Sanolino 
As the leader of this report will leam, the Kansas City con- 
ference was not only well received by the largest group of partici- 
pants (older, upper income, white males from ths midwest, in educa- 
tionsl/adminlstrative positions at the local or state level) but also 
by other identifiable groups based on ags, race, sex, region, etc.. 
These resulcs report the findings from 182 completed qusstionnsires 
administs^sd st ths fifth work group discussion on the sftemoon of 
the third dsy (Wsdnesdsy) of the conference (Ssptember 22 - 2jOO-3tOO p.m.). 
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Based on visits to each of the work groups at that time, we estimate 
that returns from some three-fourths of those in active attendance 
at the fifth work group session were obtained at this time. The 
attrition rate observed for Wednesday evening and Thursday morning 
was so large that any additional delay in administering the queationnaire 
would have been disadvantageous to say the lea8t« As it wss, the 
questionnaires were not administered under the most favorable cir- 
cumstancesf and a few of the work groupa (out of twenty) produced 
only one or a few returns. Most groups, however, had at leaat half 
of their numbers present and cooperating in the project. 

Since the Independent evaluation waa not provided for in the 
formal achedule, some participants looked on the sctivity, much like 
the Delphi, as a further and liiplanned intrusion on their time to 
be handled like the Delphi, in either in s cursory fashion or through 
avoidance behaviorl Oeapite the fifty percent (of the total group) < . 
return rate, which is usually more thad an adequate sample size, 
some qualification of these results must be mentioned. It may well 
be that the most rebellious and discontented did not respond to the 
survey, whereas the most polite, submissive, and contented did so in 
larger proportions than their real numbers at the conference. 

Cross Validation of Survey Results snd rollow-»Up 

In the absenca of a follow«MP queationnaire with a carefully 
drawn sampling and replacement scheme, the >*eubmisaive respondent" 
syndrome remains as a posaible, if not probable, explanation of these 
overwhelmingly favorable reeulte. Alao of value for croae-valldating 
external evaluation reeulte will be their eventual oomparieone with 
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the results obtained aL Kansas City from the USOE regional office 
internal evaluation at the pre-conference and conference end points. 
This external/ internal conparison, covering numbers of returns, 
objectives, strengths and weaknesses, work and special activity 
assessment, expectations and personal observations of the conference 
participants, and their commitment to citizen education should 
prove instructive. 

Utility of the Conference Evaluation fteport 

With all this said, this evaluation effort provides a modol 
for other USOE sponsored conferences, workshops, and seminars. The 
results reported provide an interesting baseline for later analysis 
and comparisons with other citizen education conferences. The forms 
produced and techniques employed are also of use to other conference 
evaluators in the private or public sectors. The practical experience 
gained by the evaluation team (which is summarized throughout this report) 
should also prove of value to future evaluators. 

Authorization and Goal Setting for the Conference 

The USOE commitment to civic education is long stancilng and of 
considerable importance* Since the 1950*8, different government- 
sponsored programs have spent millions in federal funds toward improving 
citizenship through NOEA civics teacher training institutes and Triple 
T programs for training teachers and teacher trAineri in 'political 
and social studies* However, the USOE citizen education effort is more 
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recent in its conception, less expensive in its projected costs, 
more ^itious in its objectives, and more oblique or indirect in 
its approach to this area of national concern. 

In December 1975 a meeting in Washington, D. C, was held 
(at the request of HEW Secretary David Mathews) to bring together 
a group of scholars, practitioners, governmental officials, and other 
educational specialists to explore the topic of policy-making concerns 
in the area of citizenship education. This small group contained, 
among others, HEW/USOE representatives, staff members of professional 
scholarly organizations, political scientists and educators, curri- 
culum specialists, private foundation spokesmen, and state department 
of education cfficials. Various views on citizen education were then 
exchanged (including a paper by Dr. Mathews) regarding the appropriate 
role of the federal government in the enterprise^ the significance 
of the task for citizen apathy and disillusionment; the complex role 
of education in fostering everything including civic morality and 
responsibility; civic education as a realistic process of experience, 
participation, and involvement, and the difficulties of language, 
terminology, and formal concepts in the field. Other themes emerging 
from this meeting had to do with the historical threads of national 
purpose which are evident in citizenship education; the non-formal 
aspects of education for civic responsibility; and the potentially 
radical implications of teaching democracy, ethics, participation aid 
democracy throughout a society founded on the republican principle 
of indirect governance* 
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Subsequent to this meeting other papers were produced and speeches 
delivered by Commissioner T. H. Bell ("Citizen Responsibility For 
the Common Good/' Conference on Citizen Involvement, Governor's 
Steering Committee on Education, St. Louis, Missouri, May 4, 1976) 
and Mr. Logan Sallada, Policy Advisor to the Commissioner ("Key 
Issues and Problems In Developing New National Policy Directions in 
Citizenship Education," Conference of Chief State School Officers, 
Washington, D. C. , May 1976). The Committee on Citizenship Education 
of the Council of Chief State School Officers also produced a paper in 
1976 on "Effective Citizenship Education: A Basic Goal of Education 
in the Iftiited States, and the Coiimittee on Pre -Collegiate Education 
of the American Political Science Association (APSA) frequently issued 
reports and ran articles in the APSA's Division of Educational Affairs' 
publication, DEA News , on the subjects of political socialization and 
education at the elementary, secondary, and college/university levels. 

These reports, papers, and speeches either described the operations 
of the new Citizen Education Staff 'of the USOE, or the citizen partici- 
pation model programs which were operating out of the HEW Secretary's 
office, or contributed to the on-going dialogue regarding political 
education which had as one subject of discourse the need for national 
and other conferences on the subject of citizen education. These papers 
and other documents also described basic goals of citizen education^ 
as well as the characteristics of citizenship in the United States. 
Basic questions were also posed such as: What are the responsibilities 
and rights of a citizen? What are the crucial problem areaa of American 
society? Whose responsibility is it to educate for citizenship? and the like. 
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While all of these activities were proceeding, a group of policy 
advisors for citizen education began to meet regularly to discuss the 
above-mentioned questions and to plan a scheme for a citizen 
education forum for a two-year period. This group, which included 
several persons* nfjentioned elsewhere in this report? alao began to plan 
for the first national conference on citizenship and education. With 
the atizen Eciucat Ion Staff and the HEW Secretary's office, it waa 
agreed that citizen education could be defined as follows: 

1. a policy term and a continuing proceas 

2. something which occurs at all educational levels, formal 
and non-formal 

3. something other than, or in addition to, traditional aubjecta 
such aa civics, American government, international relations 
or problems of democracy courses 

4. a topic which had emerging aapecta in the new aocial atudiea, 
e.g., political participation, global perspectives, multi-^ 
cultural, family and law related, economica, etlilcal/moral , 
and envlroninental education. 

5. Some key sectora of American society (e.g., home, community, 
education, masa media, government, etc.) were involved in 
the procesa. 

Citizen education, broadly defined, was not a new course or 
a new curriculum. In addition to these factors, a policy-making 
process/plan involving the USOE waa developed with a atrategy for 
the 1976-78 period having national and regional conferences, atate 

*(e.g.. Professor Badi Foster, Dr. Harriaon Fox, Profeaaor R. Freeman Butts, 
Dr. Sheila Koeppen of the APSA, and othera.) 

18 
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seminars, local voluntary organizations and exenplary workshops, and 
an ongoing seminar. i 

Assignment of responsibilities placed citizen-participation" demon- 
stration projects in the HEW Secretary's office, and the remainder of 
the activities with the Citizen Education Staff, The finding for all 
of these efforts came from the HEW Secretary's and U.S. Commissioner's 
offices. 

In consultation with the USOE regional office in Kansas City 
and the CCSO, it was decided to hold the first national conference 
in Kansas City. The overall conference^format was jointly planned 
between the Washington and Kansas City USOE stsffs. The Kansas City 
office, working closely with the CCSO and other professional organiza- 
tions, sought nominations of significant individuals interested or 
involved in citizen education throughout the country. More then 
2,00flper8on8 were nominated and invited to attend the first national 
conference. The inportant features of site selection, invitations 
of speakers and participants, production of a conference resource book, 
printing of a program, etc. were left to the Kansas City office with 
input from the Citizen Education Staff, Money waa transferred (some 
$123,000} from Washington to Kanaas City to pay for the basic elements 
(papers, programs, travel expenses, etc.) of the conference. 

The Kansas City USOE regional office and the Citizen Erjucation 
Staff agreed to the basic format of the conference including the 
basic conference topics and speeches, special activities, work groups, 
the Delphi process, etc. Two separate evaluation efforts, internal and 
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extemal, were discussed but no pre-conference agreement was reached 
on these procedures. The Citizen Education Staff also had certain 
basic objectives in mind which were of a national magnitude, such as 
tying the project to the National Assessment of Educational Progress 
in Citizenship and Social Studies and producing a strategy for citizen 
education for a two-year period including a network of contacts and 
a series of other meetings. The Kansas City regional office, however, 
had more limited objectives in mind which were directly tied to pro- 
ducing an effective conference and only indirectly or incidentally 
linked with the overall scheme for other meetings, seminars, and work- 
shops throughout the country. 

The descriptive leaflet distributed with invitations from the 
Kansas City regional office defined conference objectives as follows: 
"Representatives of the home, school, church, labor, business 
and government will review and consider issues affecting the 
citizen in society; issues affecting the process of citizen 
education; problems and deficiencies in current citizenship 
activities; and finally suggest what ought to be done in 
citizenship education. The conference findings will be 
used to develop additional dialogue among the decision-makers 
and other interested citizens at regional and state conferences 
scheduled from September, 1976 through June, 1977." 
This definition set forth six objectives; namely; 

1. input from six key sectors of American society 

2. review and consideration of isaues affecting citizens 

3. review and consideration of issues affecting citizen 
education 

4. review and consideration of problems and deficiencea in 
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citizenship activities 

5. ife commendations for sction 

6. production of findings useful for subsequent conferences. 
It is of some significance that despite the logicsl progression 

in this list of objectives from inputs (e.g. six sectors... etc.) to 
throughputs (review.. .etc.) to outputs (recommendations... and pro- 
duction... etc.), the last mentioned objectives hsd.,t;o do with 
distribution of the findings and their use at other meetings. As it was, 
as we shsll ssy below, the sector input was un rep resent stive, the re- 
view processes mentioned were incomplete, and the conference output 
and utility for other meetings were either nonexistent, of doubtful 
value, or pert of s post-conference salvage operation now in process 
at Kansas City (for the internal evslustion results and speaker's 
papers) or in Washington (for the Delphi and work group reports). 

As we can see from this description of the gosl setting end 
suthorization segments which preceded this conference, the divided 
responsibility and ccxiflicts in objectives which charscterized much 
of the p re-conference planning period came to fruition in Kansaa 
City from September 20-23. A description of just what happened 
there is the common theme for the remaining sections of this 
report. 
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II. THE PARTICIPANTS' VIEWS OF THE CONFERENCE 

A. Questionnaire Results; Part A 

One hundred eighty-two persons completed the 108 questions con- 
tained in Part A of the participants* questionnaire. Part A was 
divided into six sections (see Appendix I); namely: I. Background, 
views on educational innovators, and conference application procedures 
(questions 1 to 34); II, The meeting site, facilities and general 
arrangements (questions 34-47); III. The conference program (questions 
48-65); IV. Other conference inputs (questions 66-71); V. The irrpact 
of this meeting (questions 72-84); and VI. The teaching-learning 
environment (questions 85-108). 

All of Part A was answered with a common questionnaire using an 
IBM mark-sensing card and electrographic pencil for machine ^scoring 
purposes. The cards were subjected to statistical analysis using a 
computer. Frequency distributions, percentages of responses, and cross 
tabulations between critical independent (33 background questions) 
and dependent (six separate conference evaluation subscores) variables 
mie produced. A summary of the percentage distribution for Part A 
(including numbers>105S of omits) is presented below (see Appendix I). 
These results gene rally indicate that most of the participants were 
quite pleased with the conference as a whole, although certain aspects 
of the meeting were not satisfactory; e.g. imposition of the Delphi 
technique, inadequate time for rest and relaxation, overscheduling of 
the conference, and scant attention to non-educational sectors. Each 
of these sections of the survey form will be treated separately below. 
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General Numbers and Characteristics of Participants 

On the participant roster distributed toward the end of the 
conference in Kansas City, there were approximately 400 full and part- 
time participants, including major speakers, resource persons, short- 
.term participants, leaders of special activities, USOE and conference 
staff persons, and others who went throughthe registration procedures 
or were cleared through the registration desk. This number also in- 
cluded those who pre-registered for the conference and were expected 
to attend, but did not, as well as those who were in att-endance for 
one or two sessions or for one day or one night, A fair estimate 
of the largest single number of full-time, active, and working con- 
ference participants is somewhere in the range of 350-360 persons. 

The lists of special activity participants (which included 
those who pre-registered, whether or not they came) indicate some 
470 participants. The list of work group participants numbers 
some 400 names (again listing those who pre-registered, whether or 
not they came, as well as conference spreakers). Our best estimate 
of the actual nurriber of participants (based on spot checks, participant- 
observer reports, and work group leaders' reports) is an average of 
some 300 active working members throughout the conference. At the 
time that the external conference evaluation form was distributed 
(during work groi|) session #5 on Wednesday afternoon, third day of 
the conference), personal visits to all twenty work groups indicated 
a number closer to some 240 active participants. In that context, 
the return of 182 usable questionnaires, representing three-fourths 
of the active participants at that time, is more than adequate. 
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Again examining the conference roster, we find that some 205S 
(N = 77) were listed as Doctor or Professor, with no other titles 
being so conspicuous. The sector representatives on the roster 
were as follows: Labor: 4 (L'i); Homes 41 (lOS); Government: 55 
(14515); Business: 46 (lls;) ; Religion: 15 (4515); and School: 240 (60!S). 
Those from government were mostly federal and state government bureau- 
crats and administrators. From business, individuals came from news- 
papers; fouidations; research, consulting, md educational publishing 
groups; and state departments or chambers of commerce. The labor 
group was hard to identify as such, with few listed, for exanple, 
as UAW. Those from the religious sector could only be identified 
by titles such as Father, Sister, Brother, or Reverend. The school 
sector was composed of professicxial organization representatives, 
government workers, and non-profit and foundation representatives, 
with large proportions of their numbers from colleges, universities, 
and state departments of education. Those from the home were also 
frequently miscategorized, as was the education sector, with people 
from research organizations, college and university teachers, public 
school persona, librarians, study center and HEW personnel appearing 
in thia catch-all category. With these general inpressions in mind, 
let us now examine the characteristics of the respondents to our 
survey questionnaires. 



Participant's Backgrou nd. Views on Educational Innovators, and 
Conference Application Procedures . 

It is interesting to note at the outset that five percent of the 
participants believed themselves to be attending something other than 
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a national conference. Most participants were from the Midwest (48S) 
or Northeast (25%) and from large cities or metropolitan areas (74S). 
The group was two-thirds male, with two-thirds both over forty years 
of age and from an educational organization. Seventeen percent iden- 
tified themselves as from a governmental organization, three percent 
from the religious sector, seven percent from business or volyntary 
community organizations or foundations. Some twelve persons in 
the survey also categorized themselves as representing the home, four 
from labor, one from agriculture, seven from media, and one from the 
health area. These percentages are roughly similar to those dis- 
cussed above. 

Most of the participants (57?i) provide their services for others 
at the gtate or local level, but others supply them in a national (26?i) 
or regional (10%) context, with five percent doing so internationally. ' 
Nearly three-fourths of the participants are in administration (53%) 
or teaching (21?i); and over half (54S5) have been involved in educational 
work for more than sixteen years. Those who are administrators 
generally work with staffs of fewer than ten persona. 

Of the entire group, over two-thirds are familiar with new citizen 
education programs, plans, or studies currently underwsyj and an equal 
number have been primarily responsible for initiating new plans, pro- 
grams, or atudies in citizen educstion. This group also believes 
thst the two key cstegories at the local level for actual educational 
change and real innovation in the citizen education field are teachers 
and school principals/administrators (67%) . At the college and 
university level, the teschers snd professors, ss well ss individusl 
depsrtments snd disciplinea (61SS), receive the nod for such innovation, 
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as do chief state school officers and state subject-matter supervisors 
(65%) at the state level.... The respondents also believe that three 
key groups are most responsible for educational innovation in the 
United States today; namely, educational (49»); governmental (22?i); 
and private, non-profit organizations and foundations (22?i). The 
least influential groups for such change, according to respondents, 
are religious (43%) and business, labor, or agricultural (37%) 
groups* 

The individual participants also believe that they are either 
moderately or very significant (63JS) as key agents in citizen educa- 
tional change at the Jci :1, state, or national level. About half 
believe that other participants are moderately or somewhat significant 
in thi^ role. Over half of the group has had quite a bit or very 
much involvement in the citizen education field and the same number 
has had some, quite a bit, or very much involvement with the sponsoring 
organizations for this meeting. 

People came to this conference for two primary reasons — because 
they were interested in citizen education (42JS) or because they were 
invited to attend (33S). Some twenty percent, however, came because 
it was part of their job. Most heard about the conference through 
an invitation from the conference sponsors. The moat iiiportant reasons 
(60JS) for people attending this conference were to engage in give-and- 
take experiences with experts and to meet and talk with others interested 
in citizen education, rather than to obtain factual information, to 
help with their professional growth, or to leam about new approaches 
to teaching and learning in citizen education. 
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fv! mrly eighty percent of the conferees identify themselves as being 
ipper or upper middle class, fifty-nine percent are Protestant, fifteen 
percent Catholic, and ten percent Jewish. Eighty-eight percent are 
White, seven percent Black/Negro, three percent Hispanic, and two 
percent are Asian/Pacific Islander or American Indiai/Alaskan native. 
The two largest political categories chosen by the respondBnts for 
self-ascription were liberal (48S) or middle-of-the-road (3555). 

Nearly eighty percent of attendees believe that a nationwide 
reform in citizen education is necessary and point to the need for 
political parUcipation (54«), global perspectives (17») and ethnic/ 
multi-cultural education (15SS) as key study areas in citizen education. 
When given another choice of option, the valuative, ethical and moral 
education field (SOS) also joins this list, with law and family re- 
lated and social science or behavioral studies sharing the remainder 
of the support. The participants as a whole also believe in approaching 
curriculum reform in citizen education through traditional political 
studies areas (such as civics, American government, problems of 
democracy, and international relations coursea) as well aa social 
studies and interdisciplinary courses (80%). 

A Composite Sketch of an "Average" Conferee 

Baaed on the overall characteristics of the conferees at Kansas 
City in September 1976, the "typical" participant had the following 
general attributes: He was white, over- forty, '^Protestant, male, from 
the midwest, working for over sixteen years as a local or state educa- 
tional adtainiatrator with supervisory responsibilities for fewer than 
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ten persons. He characterized himself as being upper-middle-class 
and liberal or middle-of-the-road politically. He had frequent contact 
with citizen education as a field and was both familiar with new citizen 
education programs and recently involved in inplementing a new program 
in the field. This is consistent with his view of being a significant 
change agent in citizen education. The average participant believed 
his fellow conferees were also significant in this respect, but less so. 
He also maintained that the best route to local, state, college and 
university, and national change in citizen education is, respectively, 
through teachers and administrators, chief state school officers and 
state social studies sipervisors, professors and their departments, 
and local educational authorities. Educational organizations were 
viewed as most influential in educational chang^ and religious organiza- 
tions least inportant. 

"he average participant had had previous contact with the sponsoring 
organizations for the meeting and he came because he was invited to 
come, was interested in citizen education, and wanted to meet, talk, 
and exchange ideas with others, including e)fl)erts, in the field. He 
believed, as did most others, that a nationwide reform in citizen educa- 
tion was necessary, particularly in the areas of political participation 
and value/moral/ethical education. However, he also believed this ^- 
form should come through the typical political education and social 
studies courses now offered in the schools. 

The Conference Meeting Sita« Facilities and General Arrangements , 
Nearly all participants were satisfied with the dates, meeting site, 
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facilities, accommodations, meal times and breaks for the conference. 
This level of satisfaction was also true with respect to the system for 
general communication at the meeting and the reeting rooms. However, 
significant numbers wanted longer breaks (22%) and were unhappy with 
the communications system (32S), Large majorities of the partici- 
pants were unable to establish informal contacts at the meeting (6555), 
found no time for relaxation or socializing (93%), and were not satis- 
fied with the organization and scheduling of the conference (54S), 
These loyal participants attended three-fourths or more of the con- 
ference activities (888) and were active participants in group dis- 
cussions (91SJ), Most significantly, eighty-five percent o f the con- 
ferees found the Kansas City meeting to have been valuable to them 
personally. 

The Conference Program, Registration, and Receptions , 

Little fault was found with the conference registration proce- 
dures and "no host" receptions. This was also true with respect to 
the formal presentations through Wednesday afternoon. The most highly 
rated of these speeches was that by Professor R, Freeman Butts on 
"An Historical Perspective of Citizen Education which was rated 
"excellent" or "above average" by seventy-two percent of the participants. 

By Wedhesday afternoon, the participants had heard seven pre- 
sentations. However, the conference evaluation form was unable 
accurately to assess all seven of these presentations because of the 
incomplete or inaccurate information available at the USOE in Washington, 
D, C, , through Friday, September 17, three days prior to the conference. 
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Ideally, the day, date, time, time, title, and name of the speaker 
in correct order of presentation should be provided to the evaluator 
in advance, so that questionnaires can be devised to provide an 
accurate assessment of its impact. Since this information was lacking 
prior to the conference, the only route available for a total conference 
view of the ten major presentations, as well as other speeches, would 
be through a conference follow-tp questionnaire. Reaction to these 
specific presentations is covered in Part B of this Section and 
below in Section IV of this report. We have some indication of 
participants' overall reactions to the presentations. Fifty-eight 
percent of those responding rated them as being "excellent" or "above 
average," However, the specific worth of each effort will remain 
something of an open question until more solid information is available. 

As we have just mentioned, the presentations w*>ite highly rated 
by over half of the conferees. An equal number similarly rated the 
special activities, although more in that group rated them "excellent," 
The work groups, showing slighly over half "above average" or "excellent" 
ratings, present a different problem. The work group evaluations 
indicate a larger "excellent" rating than the presentations, although 
leas than the seven special activities; but they also received the 
highest "below average" ratings. This indicates that the work groups 
were a mixed bag, depending on the characteristics of the group leader- 
ship, participants, group process, and other variables. Some insight 
is also available into these factors in Part B of this section wd in 
Section IV of this report; but again a follow-up questionnaire would 
be necessary to focus on what benefits the participants derived from 
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the most successful and what was lacking in the least successful 
work groups. 

One other observation is also relevant in evaluating program 
activities; that is, one of the evaluation questions referred to 
the Delphi survey. (All- program items were listed since a reasonable 
plan for administering the evaluation was arranged only when the 
meeting was half-over.) Although most participants did not respond 
to this question, the vehemence and antipathy felt toward the Delphi 
process was signalled by the fact that over half of the respondents 
rated the process as "below average" or "poor/* More will be said 
on this matter immediately below as well as in section VI of this 
report. 

Other Conference Inputs; Objectives, Resou rce Materials, and 
the Delphi . * 

Most participants were satisfied with the displays of curriculum 
material and the pre- conference information; but a sizeable number (27S) 
wanted better information prior to the, conference. Perhcps even more 
important is the fact that forty-two percent of the participants were 
not satisfied at this point in the conference with the definition pro- 
vided by the leadership for the purposes and objectives of the conference. 
Large numbers (56SJ-68K) were also unhappy with the use of the Delphi 
instrument before, during, and toward the end of the meeting, and the 
most hostility was registered regarding its use in-session. 

Conference Impact; By Sector^ Government Level, Problem Areas, 
and Reformulation of Citizen Education . 

Thirteen separate questions were aske* about the impact of the 
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conference on eight sectors of American society, three governmental 
levels, the crucial problem areas, and the production of a necessary, 
practical, and desirable plan for the reformulation and regeneration 
of citizen education for the present and future. Again keeping 
in mind that this assessment took place two-thirds of the way through 
the meeting, rather than at the end, we can see that large numbers - 
from 45% to 75% - believed that; the conference had not properly addressed 
citizen education in the religious, business/industry, labor, voluntary 
organization, agriculture, and local and state government areas. 
Nearly all agreed that the school and citizen education had been 
effectively approached; and the large majority (65S5-.74?o) also believed 
that the home and community, federal government, and mass media 
had been adequately covered, as had the crucial problem areas. 
Perhaps even more significant, in terms of the ambitious conference 
objectives, however, is the fact that nearly half of the participants 
did not believe that a new plan for civic education was produced 
at the conference. 

The Teaching/Learning Environment . 
This section of the questionnaire dealt with the conference as 
a general educational experience «- with matters such as the participants' 
views of the conference leaders as teachers, the value of group dis- 
cussions, personal motivation, and the conference materials and pro- 
cesses. Participants indicated that they had assumed personal responsi- 
bility for making the conference as productive as possible. Other highly 
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scored items were the subject matter knowledge of the leaciership, 
the stimulation and motivation provided, the favorable^ learning atmosphere, 
the value of the presentations; and the skill of the conference leaders 
in speaking, organizing, explaining, answering questions, and inter- 
acting with the participants in a fair, impartial, tolerant, sensitive, 
and jovial fashion. 

At the other extreme, however, the conference and its leadership 
were rated much lower in the extent to which the conference duplicated 
other meetings (however, this question may be defective because of 
phrasing), the unwillingness of the leadership to adjust the meeting 
to the expressed needs and interests of the participants, and 
one major defect of the meeting in terms of its logical, meaningful, 
and davd^opmental sequence. Certain problems were also noted with respect 
to the group discussions, in that over one-fourth of the participants 
rated these groups as "below average" or "poor" and some twenty percent 
were not pleased with the groif) facilitators or host/recorders. Another 
aspect of the conference which did not receive high or passing grades 
was the conference reading book and other printed/duplicated material 
at the meeting. Nearly one-third of the respondents rated this material 
"low-/' as they did the extent to which the conference balanced concerns 
for theory and application. Significant numbers (19S-20S) also wished 
to have more informal contacts with the grotp leadership before and 
after the formal sessions. 

Summary of the Average Participant's Evaluation of the Conference . 
The average participant was satisfied with the conference site. 



33 



-28- 



dates, meeting facilities, communications system, accommodations, meals, 
and breaks. He was not satisfied with the overscheduling and rigid 
time frame for the meeting, however, and wanted more time for rest, 
relaxation, informal contacts, and socializing. He was a faithful 
attendant at nearly all conference meetings and believed the meeting 
was of personal value to him. He also believed the registration pro- 
cedures, receptions, presentations, work groups, and special activities 
were of value. He was not at all pleased with the use of the Delphi 
technique and he was unclear about the objectives of the conference. 
He also thought that the conference adequately addressed home, school, 
mass media, and federal responsibilities in citizen education, as 
well as the crucial problem areas. But this was not the case with 
respect to religion, business, labor, agriculture, voluntary organiza- 
tions, or local and state government areas. Pprhaps the biggest dis- 
appointment to the average conferee was that a "game plan" for citizen 
education did not unfold during the meeting. The average participant 
also believed that he had made a personal contribution to the success 
of the conference. He was stimulated and motivated by the presentations 
and the pleasant learning environment and was impressed with the 
subject matter knowledge of the conference leaders as well as with 
their other teaching skills and personality characteristics. 

This composite view of the typical participant's reaction to the 
conference must also be qualified in the sense that it reflects his 
opinion at that one point in time two-thirds of the way through the 
conference. Thus, it may suggest but does not reflect his final 
opinion. Only a follow-up evaluation would provide us with this infor- 
mation about what the participant has done in the citizen education 
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field as a direct result of this meeting. Moreover, the majority 
view does not adequately reflect the vi«vs of significant 
minorities (each such minority represented at least 205S of the 
respondents at this conference) who were not satisfied and who be- 
lieved that the meeting site, facilities, and general arrangments 
could have been improved and deficiences corrected (465S), that the 
breaks were inadequate (29»), or that the communications system needed 
improvement (3251b). The large minority who were not satisfied with 
certain presentations also deserve a hearing, as do those who wanted 
better pre- conference information, better work groups, more informal 
contacts with an inproved leadership, better use of printed conference 
materials, and a better balance between theoretical and practical 
matters in citizen education. 

Cross Tabulation Results 

A fairly elaborate computer cross tabulation between certain 
of the first thirty-four background or independent variables Cregion, 
age, sex, occupation, ethnic group, etc.) in the questionnaire aid 
six composite or dependent variables (i.e. question 45 - value of 
the conference; questions 49 to 55 - conference program; questions 
63 to 65 - presentations, work groups, and special activities; questions 
72 to 84 - sectors, government levels, problem areas, and civic educa- 
tion reform; and questions 85 to 108 - the teaching/learning environ- 
ment) produced 135 separate tables comparing five different high and 
lovf ratings with the two to five different response categories (e.g., 

J-., ^-^male or northeast, southeast, midwest, northwest, or southwest). 
2 

square (X ) was also conputed to compare the significance levels of 
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expected and observed results and the degree to which they were within 
a reasonable level of not being chance results. (The ,05 level or 
above indicates the observed results have only a five in one-hundred 
possibility of occurring by ch^ce whereas for the ,001 confidence 
level there is one chance in a thousand the observed results will 
occur by chance. The ,05 or 95% level is the usually expected 
criterion in educational and social science measurement,) 

Since space and time restrictions do not permit a thorough examina- 
tion or a complete discussion of all of these results, we have merely 
analyzed what is perhaps the most important dependent variable; 
that is, item 45 - value of the conference to the individual partici- 
pant. By comparing twenty-three selected background variables 
(e.g. religion, sex, age, etc.) with one's estimate of the personal 
value of the conference, we find that half of the items did not 
indicate significant differences. The other half varied in significance 
levels from .05 to .001, 

Region of the country, type of educational work, work responsi- 
bilities, initiation of, or familiarity with, citizen education 
reform, personal significance of oneself as a change agent, selection 
of influential organizations for change, reason for attending the 
conference, need for reform of citizen education, and selection of 
a crucial study area were not significantly different from chance 
responses in terms of estimating the personal value of the conference 
to the participant. However, the population of one's work area, sex, 
age, type of organization, years in education, ascription of responsi- 
bility for change, estimate of the significance of others, previous 
contact with civic education and the conference sponsorj; ethnicity, and 
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identification of one key study area were at an acceptable level of 
significance (>,05) to warrant further statistical analysis. 

For example, these cross tabulations indicate that the following 
types of persons expressed disappointment or reservations with the 
value of the conference to them: those from large metropolitan 
areas, whites, males, persons between the ages of 30 and 50 years, 
educators in the field from six to ten years (and over twenty years), 
those who believe that local educational agencies are most responsible 
for citizen education reform, those who either think their fellow 
participants are moderately significant (or who cannot estimate their 
significance) as change agents, those who have had quite a bit of 
(or very much) contact with citizen education and very little (or 
just some) contact with the sponsoring organization, and who identify 
the evaluative, ethical, and moral study area as being most crucial 
for the future success of citizen education in the United States. 

Oily an additional and more sophisticated statistical treatment, 
such as a multiple regression analysis, of these results would help 
us to determine which combination of background variables best explain, 
subscores such as the teaching/learning environment. However, these 
cross tabulations allow us to hypothesize that there is a pattern of 
evaluative response levels which is statistically and significantly 
associated with certain interest areas - such as the moral/ethical 
study area, in that persons most invplved in such areas were least 
satisfied with the conference. Any more complete discussion of these 
dimensions will have to await further statistical analysis of 
the results, such as a factor analysis of the teaching/learning 
subscore which would allow us to sort out those fa^ and essential 
educational elements which underlay this conference and its general syccesses. 
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B. Questionnaire Results: Part B 

An open-ended questionnaire (see Appendix II) of six pages with 
twenty-seven separate questions asked participants about how long 
it took them to complete both questionnaires , their names and addresses 
(optional), the major objectives of the conference, strongest and 
weakest points, suggestions for inprovements, expectations, willing- 
ness to participate in other citizen education activities, and their 
evaluation of the evaluation process itself. Despite the fact that 
all participants present at the fifth work group session received 
copies of this form, only about half (N = 87) of those who conpleted 
Part I returned the form by mail. This figure is about one- third of 
those present at that work group session and over one-fourth of the 
number of active conference participants, (See Appendices VI, VII, 
and VIII on categorization and listing of participant responses, 
such as willinghess to participate in the future civic education 
activities and strongest points of the meeting.) 

Question 6b. asked: "What sector do you represent? (Check one)" 

The question identified eleven sectors and provided space to 
check Other (Please specify). 

All 87 participants who completed Part B responded to this 
question by checking at least one sector. Five of them checked two - 
with "Education" one of the choices in f^ach instance. Four of the 
eleven sectors were not represented: Labor, Media, Health, and 
Agriculture. No one indicated "Other.'' 
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Sector representation among respondents to Part B correlates 
quite closely with the representation indicated on the participant 
list and from machine-coded responses to Questions 6 and 7, Part A, 
as charted below: 
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Questions lb and 26b asked how many minutes it took for partici- 
pants to complete Part A and Part B. An analysis of these responses 
indicates that the average time for Part A was 28 minutes and for 
Part B, 27 minutes. Most participants spent from 20 to 30 minutes 
on each of the forms. Question 5b asked what role/function the re- 
spondent played at the conference with the following results: 
participant - 58; resource person - 1; presenter - llj reporter - 9; 
discussion/work group leader - 5. Three persons did not reply and 
no one indicated he or !::he was a staff member despite the fact that 
some USOE staff responded, but chose to identify themselves with other 
conference roles. 

Question 8b. asked: "What were the major objectives of this 
meeting as you perceived them?" 

In responding to questiui 8b. , participants revealed ten different 
categories of perception, or wnys of looking at conference objectives: 

To exchange information on citizen education by imparting 

it, by learning it, and by sharing it. 

To establish the need for citizen education. 
. To promote understanding of citizen education. 

To consider goals and priorities for citizen education. 

To discuss implementation of citizen education. 

To address problems of citizen education. 

To improve citizen education. 

To review the current status of citizen education. 
. To set up action networks for citizen education. 
To promote citizen education awareness and action 
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Question 10b. askeds ••What were the weakest points of this meeting?" 
A swBiaiy of responses follows. 

STRUCTURE. The conference wee too rigorously structured, with 
particular regard to program scheduling and the work group process. 
Scheduling. . The work day was too long and too full. 

. There was almost no free time for relaxation, 
recreation, "visitingi" and informal discussion. 
Work Cro up Process . The Delphi proceea proved counterproductive as 
implsMnted in the work group sessions* 

• There Mfas too much "process/' with too much paperwork. 

• Critical probleme were not adequately addressed. 
RECRUlTfCNT. The invitation proceea waa faulty as to participantsi 

pressnters, and work group facilitators. 
Parti cipwts . ' 

• There were too many representstivee of the "education" 
sector. 

• Women I minorities, and special intereats were 
undsrrepreaanted. 

Preeentera . Some of the preaantsre failed to address the topice aeaigned 
to them. 

racilitatora* Some of the facilitatora managed their work groupe poorly. 
COMMIMI CATIONS. Information«exchange proceeaee were inedequste 
before and during the conference. 
Pjrtioipant Orientation . 

. Conference and work group objectives were not clear. 
The pre-planned proceea for attaining conference 
objectlvea waa never adequately explained^ with 
particular reference to the Delphi 
Croaa^Cowm unioationa . There wee inaufficient aharing of information 
among concur rent aeaeiona. 
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A8 one example of a participant's own detailed, thoughtful, and quite 
coirplete answer to this question the following verbatim reply is presented: 



'*10b. What were the weakest points of this meeting? (continued) 

Lack of clear objectives. The objectives for the meeting were not 
clearly stated and made known to all participants before the conference. 
Hence, many people had no clear sense of why they were invited to the meeting 
nor what the meeting was really about. This seemed to be especially true of 
many of the non-school people at the meeting. Lack of a clear sense of purpose 
made it difficult for people to contribute efficiently to the progress of the 
meeting. 

Ovar-organization , The agenda for the meeting was overly organized and 
did not allow SMffldent time for informal interaction among the particlpanta. 
This was perhaps the single biggest problem at the meeting. The people felt 
pushed and rushed. Participants had no time to renew old acquaintances, 
make new ones and profit from the Informal but important exchanges of ideas 
and information which takes place at conferences of this type. 

In addition, the extremely eight — even ridiculous — scheduling led to 
resentment on the part of maciy participants. People felt they were being 
treated as children whose every minute had to be scheduled and supervised. 
As a result, many of the participants were much less productive than they 
might have been had the achadule been more realistic. 

Inappropriate use of the Delphi technique. The Delphi questionnaires 
administered prior to and during the meeting were grossly misused . Prom 
a technical standpoint, the Delphi Instruments used were not well constructed 
and any evidence gained from them cannot be considered reliable or valid. 
In addition, as they were used and constructed the Delphi instruments offered 
no real common ground for discussion among various participants. Early on 
many participants began to develop strong negative reactions to both the 
content of the Delphi Instruments and to the manner in which they were 
administered in small group sessions. Again, people felt as if they were 
being treated like children. In addition, the artificiality of the content 
of the Delphi instrument soon became apparent and caused considerable 
resentment among most particlpanta. The prevalent attitude at the conferenci* 
soon became, *Ve*ll fill these out if you demand It but we think they^re 
a waste of time." 

Inappropriate recruitment techniques. Shortly after the medClng began 
it became apparent that many of the non->acadefflic particlpanta had been 
invited to the meeting simply because their name appeared one or another 
organisational mailing list. While many of theae people were sympathetic 
to citisen education, they had no background or real interest in the area. 
They had come to the meeting either because they were ordered to do so by 
a superior in their orgsnisation or almply because of some uninformed but 
sincere sense of obligation. What was missing were community leaders and 
citlsene actually involved in varioua aorta of civic and community projeota 
While it is not eaay to identify auch people on a national scale, the 
meeting could have greatly profited from the experience and insight of such 
citisens/' 
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Question lib. asked: "How could meetings such as this be 
^improved in the future?" 

Six major recommendations emerge from analysis of the responses 
to this question: 

1. Improve advance preparations for the conference: 

• by clarifying objectives and the plan of action for 
achieving them. 

• by assigning "homework". 

2. Schedule the agenda loosely. 

• Allow some free time. . . 

• Allow time for participant interaction i both formal and 
informal, . 

3. See that presenters address their assigned topics. 

4. Broaden the base of participatioi , to make the roster of 
participants more representative of a crosa-section of 
American society. 

3. Deviae a more productive process for the work groups, 
6. Arrange for cross-communication among varioua conference 
activities - and particularly! among concurrent seaaiona. 
Question 16b. asked: "Would you be willing to participate in 

an on-going effort in the near future for citizen education? Yea 

Ho Do Not Know Explain: ^" (See Appendix VI) 

' Of the 87 respondents, one entered NA (not applicable). The others 
divided aa follows: 

Yea 75 
No 1 
Oo Not Know 10 
86 
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Twenty-three reapcndenta checked ''Yea" and added qualifying 
commenta. Thoae commenta indicated; 

Cnthusiaam • 9 reapcndenta 

Importance of the aubject 6 

Time conatraints 3 

Wlllingneaa to participate . • • . \ 2 (locally: 1; regionally: 1) 

Oeaire for cleanr goal 
orientation 2 

Aa continuation of pre-exiating 
profeaaional activity 2 

Oeapite negative reaction to 
conference 2 



26 

The total number of reaponaea exceeda 23 becauae aome of the 
anawera incorporate more than one concept. 

No. The "No" reaponae derived from negative reaction to the 
conference, but did not cloae the door to future participation under 
conditiona deemed more favorable. 

Do Not Know . All ten respondenta who checked "Do Not Know" 
added qualifying commenta; and all of the commenta auggeated minda 
open to the poaaibility of future participation under favorable 
clrcumatencea. 

Five of the reapcndenta mentioned time conatralnta. 

Three othera apoke in terma of peraonal conpetence and external 
conditiona in a contination which would favor their making a uaeful 
contribution. 
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Question 27b asked; "Could this evaluation procedure be improved?" 
(Please explain) 

About half the respondents did not reply to this question. 
Of those that did, ^out half said "no" or"probei)ly yes»'and the 
remainder offered suggestions. By far, the most frequently heard 
complaints we:re that: the procedure was too long and time consumingj 
had errors in the listings of activitieaj repeated what had been asked; 
had some irrelevant general queationa such as those on the teaching/ 
learning environment. On the other hand, many respondenta were quite 
pleased with thia opportunity to evaluate the event and expreaaed 
, hope that their contribution to the effort would be heard and acted 
Mpon. Many alao took this opportunity to repeat their good feelings 
about the conference in general and citizen education in particular. 
Many of these auggeated improvements in the evaluation process will 
be implemented in any future efforts in this area. 

• 

Summary of Part B Reaults 

Time and space restrictions do not permit us either to summarize 
or list all of the responses to all of the questions in Part B of 
the evaluation form. The eight illustrative questions trea,ted in 
some detail above indicate that the average respondent was representative 
of the conference group as a whole, spent less than one hour evaluating 
the conference, and had his or her own conception of the objectives 
of the conference, which differed with the person and with those of 
the conference plannere. The most impori«it of these objectives 
seem to be the information exchange and citizen education process goals. 
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The average respondent was pleased with most of the presenters and 
special activities and rated his interaction with fellow participants 
highly. But the structure, recruitment, and communications difficulties 
detracted from his effectiveness as a participait. Suggested improve- 
ments again have to do with improving clarification of conference 
objectives, loosening the schedule, and providing for better inter- 
action and participation. Most significant is the fact that the over- 
whelming majority of respondents is willing to participate in 
future citizen education efforts, with some qualifications and pre- 
conditions. Finally, the responses to question 27b indicated that 
ttie external evaluation, although lengthy and time consuming, was a 
valuable asset to the conference. 
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III. THE LEADERS' VIEWS OF THE CONFERENCE: 
WORK GROUPS, SPECIAL ACTIVITIES, RESOURCES, AND PRESENTATIONS 

A. Facilitators, Hosts, and Their Work Groups . 

The work group facilitators and host/recorders were given a 
separate evaluation form (see Appendix III). There were forty such 
forms distributed and twenty were returned. This represented one-half 
of the total number of facilitators and hosts and two-thirds, or four- 
teen, of the twenty work groups. Most of the leadership (N = 13) were 
from the educational sector or from government (N = 6). 

Major Group Objectives 

These conference leaders identified four major groups of ob- 
jectives for their groups, as follows; 1. To discuss group concerns 
regarding citizen educstion problems and to encourage sharing of 
experiences and participation in the group j* 2. To refine the key 
problems facing society and citizen-education, to make recommendations, 
and to design a realistic strategy foresting these problem areasj^ 
3, To rank the issue /problem areas, to work with the Delphi survey, 
and to respond to stated problems and tasks ;^ and 4, To produce a 
synthesis and definition of a citizen, good citizenship, citizen 
education, and its objectives. 



^Indicates frequently mentioned response. 
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Relationship Between Group and Conference Objectives 

Various views were expressed by the group leaders as to the relation- 
ship between their group and the conference as a whole. However, 
most saw the two as closely interrelated* and only a few observed 
any discontinuity between the stated tasks and the needs of the group. 
Some mention was made here of time constraints on the group process 
or the baneful influences of overstructuring or use of the Delphi 
process. 

Achievement of Objectives 

Most of the leaders acknowledged that the group's objectives were 
achieved* in that the assigned tasks (e.g. the Delphi survey) were 
completed and group dialogue centered on problem areas, citizenship 
for the future, and outcomes of citizen education. Several leaders 
also indicates tnat the groups largely ignored or treated their assigned 
tasks superficially and then got down to constructive discussion of 
citizenship, problem areas, the tasks of citizen education, sector 
responsibility, ind major outcomes for citizen education. As a whole, 
it seemed as though most groups faltered initially and within a day 
began function! effectively. 

Objectives Not Achieved 

This section of the questionnaire allowed the leaders to express 
their disappointments with the group process. Here there appeared 
a scattering of responses which included the following: Lack of time 



♦Indicates frequently mentioned response. 
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or too much overs true turlng for group interaction;*- consternation with 
the Delphi process and the problem areas there denoted as being 
nebulous, unclear or undefined;* frustration that certain responsibilitie 
were never faced or were encountered too late in the group* e.g., defi- 
nition of problem areas and citizen education goals, problem solving, 
recommendations for citizen education, and assignment of sector responsi- 
bility. Other comments from leaders worthy of some mention were that 
the groups were too WASP-oriented to cope with the realities of citizen 
education or that the educators and government people could not in- 
telligently discuss other sectors. Still other leaders accused 
certain group members of subversion. One host ascribed the cause of 
group frustration to the facilitator's passive role; and another asked 
for more flexibility in the leadership to drop unsuccessful plans 
regsrdless of the pre-planning effort. Finally, one optimistic host 
reported that all group objectives were achieved, the group was happy 
with their end product, which in turn was a positive contribution to 
the conference. 

Suggested Improvement for the Group Process 

As with the previous section, a variety of suggestions for im- 
provement of the group's finctioning were listed. These included! 
more time for group discussion;* less paperwork and structure, simplify 
the format, and provide fewer activities;* more diversity and lay group 
(sector) representation;* longer work sessions and no after dinner 
or night-time meetings;* more time to reflect and not merely to 
react; modify use of Delphi format by more pre- conference activity. 



^Indicates frequently mentioned response. 
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by not defining the group' e taek prior to the meeting, or by a general 
statement of Delphi outcomes at the start of the meeting for conference/ 
work group input;^* provide better training of group leaders for pro- 
cess, not content, goals; allow for basic agreement on grotp pur- 
poses, goals, tasks, and definitions at the start of the meeting; 
loosen the conference schedule to provide for more flexibility and 
different types of activities in each grotp session;* ensure that 
group leaders are committed to the conference goals; allow groups to 
select their own problem areas first, determine outcomes next, and 
from then on decide on action, activities, and sectors-~also, assign 
one of Delphi problem areas for brainatorming; use group session to 
bring together different groups (law, global, family, etc.) to develop 
a coherent composite of citizen education. 

Summary of Facilitators' and Hosts' Views 

It would appear that the group leaders believed that the work 
groups were vital to (one referred to the "guts" of) the nonference 
and that they achieved their own as well as the gp^aral conference 
objectives. Most of the leadera saw the work git)>jpc< as a place for 
interaction and individual input into a highly atruotured and time* 
consuming conference. They wanted longer sessions. ;^ more open format, 
less structure, and better trained leaders. The ^j-lph^ procx^ss 
waa conaidered well intentioned and useful in tei s of" :j r.n obtained, 
but misused in the light of overall overstruL'tuiJnij constraints. 
Useful suggestions for overcoming noted deficienceo mbvo mon^ 'x^ed, 



^Indicates frequently mentioned resporte»* 
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auch as using Delphi results as reference points or inputs after the 
groip process had begun on its own list of problem areas in citizen 
education. Some recommendations, such as the need for more sector 
representation, are consistent with other deficiencies noted in Section II 
of this report. 

B. Special Ac tivities Leaders. Resource Persons, and Presenters . 

Two separate evaluation forms (see Appendices III and IV) were 
provided; one for the special activity leaders (also called coor- 
dinators and chairpersons) and a second for the resource persons, 
speakers, and panelists at the special activities or the speakers 
(also called presenters) at the ten general sessions. In all, there 
were twenty-eight special activity sessions, with a total of eighty- 
seven panelists and ten group coordinators listed and thirteen general 
session speakers. Thus, we have a grand total of some 110 persons 
involved in these conference activities. However, since sone of the 
speakers, resource persons, and panelists did not attend the con- 
ference, we have an actual count closer to 100 persons. Dividing 
the speakers and others into their respective categories, we find 
the following. figures for seven special activity groups: coordinators, 
N s 10; speakers and resource persons, N s 87: A. ethics, N s 8} 

B. global perspectives, N = 10; C. politics, N = 18; D. multi-ethnic, 
N = 13; E. law related, N s 13; F. economics, N s 19; and G. family- 
related, N = 6. There were thirteen presenters listed for the ten 
general sessions. 

These forms were distributed by the evaluators and citizen 
education staff to group leaders for their use and for later dis- 
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tribution to those participating in a leadership capacity. In 
all, twenty-three or some 22;S of the forms were returned, nearly 
all by return mail. However, half of the special activity leaders 
returned their forms. Only four of the respondents were sionymous, 
and about half of those signed and returned were from female leaders. 
The sectors represented were mostly from education and government, 
with a few from media or from business and industry and the remainder 
from nonprofit or voluntary organizations or research groups. 
The special activity leaders represented in this survey are primarily 
from law, economics, and political participation. The speakers/ 
panelists/resource persons represented all of the special activity 
groups, particularly the family-related, law, economic, and political 
participation groips. These leaders, parUcularly the coordinators, 
were present at the conference for three to four days (N a 12), one 
to two days (N s 6), or for a few hours or half a day (N s 5). In 
addition to the general sessions and special activities sessions, 
many of these conference leaders also attended other special activities 
and general aesaions, work groups, and in nearly half the cases, all 
of the conference activities. 

Major Ob.lectives of the Conference . 

The principal objective for the conference as seen by this group 
was to bring civic educators together to list agenda items, including 
federal poUcy, for nationwide tasks and through discussion and 
sharing to resolve any serious conflicts;* to make citizen education 



♦Indicates frequently mentioned response. 
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a national effort by defining concepts, key iaauea, and major pro- 
blema;* to improve citizen education for the maaaea and for elementary 
and aecondary education; to prqvide diffusion of citizen education 
programs, ideaa, and strategiea, particularly in family education, 
economica, law, and political participation education.* 

Profeaaional Effort and Conference Objectivea 

Moat of the reapondenta merely repeated here the title of their 
talks e.g., "an hiatorical perspective on citizen education", "citizen 
participatory action/' "global perapectivea on citizen education/' 
etc. Aa aeen above, the moat prominently mentioned topics related 
to law, economica, family, and political participation education. 
Typical of some of the ahort-term participanta in the conference, 
one reapondent reported that he "waa not in at ten dance... long enough 
to give a qualified anawer" to the queation. 

General Impreaaions of the Conference 

Theae obaervers generally found the aite to be aatiafactory 
and no criticism on this score waa mentioned. The conference ataff 
waa deacribed aa "hard working /'yet the work group facilitators 
were frequently aingled out for their inadequaciea in diacuaaion 
leaderahip. The Delphi technique waa alao criticized aa having too 
inpreciae, interdependent problems, and being impoaaible to build 
on in a single work session. Work sessions, in turn, were varioualy 
deacribed aa "much too general" and "a farce/' Another obaerver found 



*Indicatea frequently mentioned response. 
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the participatory level in special activity sessions to be too low. 
And still another thought the conference "a good forum" for presenting 
his civic education program and for learning about other new economic 
programs. 

Mixed reactions to the program were also recorded. One presenter 
sent a letter to Acting USOE Commissioner William Pierce in which he 
attacked the use of the Delphi technique as being about as effective 
as appealing to the Greek oracle for which it was named. Other observers 
also frequently criticized this technique as they did the "disjointed," 
"crowded*; and "overstructured" program and schedule. Still others 
questioned the clarity of conference objectives, the overall design, 
the substance of the conference, and the citizen education awareness ' 
of some of the speakers. However, a different group found the con- 
ference to be "acceptable," "informative," "pertinent," "interesting,", 
"well organized," "novel," "big and busy," and "very good". • 

General Problems at the Conference 

Many different observations on the conference identified 
certain critical problems such as: 1. The need for more citizen 
participation group representation such as Common Cause and the 
Nader grot^. 2. More emphasis on what is right, rather than 
wrong, in citizen education was needed by starting with a discussion 
of what is right in the field and what can be replicated and mad& 
more available. 3. The whole question of the representation of 
women* needs to be reevaluated. The female speakers were unrepresentative, 

♦Indicates frequently mentioned response, 
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and only ten percent of the articles in the resource book were written 
by women. 4, There was criticism of too many presentations by 
academicians and of the alleged "gap" between practitioners and 
subject matter specialists. 5. More time for preparation was re- 
quested. Everything seemed hurried and late. 6. Smaller raeeUnga, 
and more of them - with a program built on successful existing 
citizen education experiences - were r quested. 7. The need for a 
special task force of higher education persons who are responsive 
to schools and the community was offered as a suggestion. B. Thp 
Delphi forms were attacked* once again with criticism of the time spent 
on them. Suggested improvements were the editing of results and the 
presentation of edited results to participants so that the group 
activity could proceed. Although the Delphi process was "well intentioned 
the observer was "skeptical" of the results obtained because of the 
"forced" nature of the process. 9. Other criticisms concerned 
poor arrangements for hotel accommodations and conference information, 
the lack of action by conference planners in response to participant 
complaints, and the poor quality of the work groups*. 10. The 
special activity groups were well received als being*"solid" and in 
need of expansion*. 

Summary of Coordinators' and Speakers' View g 

This segment of the conference leadership had many responses 
in common with those of the hosts and facilitators. There seemed 
to be general agreement on the objectives of the conference, but 



*Indlcate8 frequently mentioned response. 
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the relationship between one's professional contribution and these 
objectives was unclear to respondents except in the most basic and 
sinplistic fashion. Respondents seemed hard-pressed and unable to 
place their contribution in proper perspective to the conference as 
a whole. As with other observations noted previously, these 
speakers and leaders detected difficulties with the tight structure, 
the malfuictioning work groups, the lack of female speakers, and 
the misuse of the Delphi technique. These respondents were pleased 
with the special activities sessions and wanted them expanded to 
the Doipt where what was effective in the field could be seen, 
evaluated, and taken home for implementation and application. 
The speakers/leaders also wanted to improve the sector representation 
at the conference. Overall, however, this group was satisfied 
with the conference, but saw that it could be improved. 
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IV. THE EVALUATION TEAM'S VIEW OF THE CONFERENCE: 
Presentations, Work Groups, and Special Activities 

This section of the report summarizes the seven member eval- 
uation team's views on the major presentaticxis of the conference 
as well as the work group and special activities sessions and other 
facets of the meeting such as registration procedures, coffee 
breaks and receptions. A participant observer's evaluation form 
(see Appendix V) was used by the evaluation teanri tc ensure some 
uniformity in general respcxise format for the open-ended replies. 

Registration Procedures, Receptions, ard Coffee Breaks 

The registration procedures were more notable for their m- 
eventful nature, rather than for any glaring defects. Since so 
many had p reregistered, this lengthy procedure could have been com- 
pressed into a shorter period of time perhaps from four hours to a 
maximum of two. Furthermore, the registration period could have been 
ueed to good advantage to; 1. administer the pre*confez^ce in- 
ternal evaluation form; 2. check on whether the Delphi form had 
beer sent, received, and/or completed by the participant prior to 
the conference; 3. ask participants who had not received the Delphi 
survey either to complete it on the spot or prior to the first work 
groip session. This procedure would have assured the Delphi of 
a somder footing later in the conference. 

There was some evidence of overly officious, formal, and even 
unfriendly registrars. Those persons selected to organize this 
important initial activity should be such as to evoke warm, friendly. 
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cooperative, and helpful interaction with participants, rather than 
an assembly line, routinized, impersonal, large scale, and cash-nexus 
orientation. 

The receptions held on Monday, Tuesday, and Wednesday evenings 
were well attended and accomplished their major socializing function. 
There was an aura of excitement and anticipation present at the 
first reception, and many had a chance to renew old friendships as 
well as to make new acquaintances. , This esprit de bon vivant cnri 
good fellowship carried over to the second reception, as did the 
continual socializing. By the third such event, however, fewer were 
present; and the effects of the intensive meeting schedule had begun 
to show physically and to be expressed verbally by the confereea. 
The horsrd'oeuvres, however, were plentiful and devoured quickly; 
and the stiff price for drinks (e.g. soft drink per glass - 75ji) did 
not inhibit consumption so much as elicit surprise that the conference 
fee had not covered the affair. 

The conference fee also provided nine meals for participmts. 
These formal eating arrangements were variously received by members 
of the evaluation team. Evaluators cited the formality of these 
affairs, referring to them as "three banquet sessions per dayj«»» or 
the fact that the seating arrangements which collected some ten persons 
around a table provided them with an opportunity for interchange which 
might not have been possible otherwise. The food presented on these 
occasions was up to large hotel and banquet style standards, with the 
usual criticisms heard.* One of the evaluators, aftei* having been 

indicates frequently mentioned response. 
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served with popcorn soup on one occasicn and strawberry soup on 
another, became convinced that a child chef was in the hotel kitchen 
trying out recipes from a kindflrgarden cookbook I Still aiother 
observer was fascinated with the names of halls utilized for a 
conference on citizen education in a democracy ; e.g. The Imperial 
Ballroom, the Royal Hall, and the Grand Ballroom - somewhat anomalous 
names, indeed* All meals, particularly dinner, were well attended* 
with the breakfast sessions being most sparsely populated despite 
the fact that the formal presentations were each tied to an immediate 
post-mealtime schedule. Indeed, mealtines predominated for plenary 
sessions, save for a few other presentations or general sessions 
toward the end of the conference. 

Before proceeding to the major presentations, let us also mention 
something of the coffee/coke breaks, since they also regularly con- 
sumed some of the conference time. These activities happened twice 
a day. No separate charge was made for them, and anple supplies of 
fattening and non-fattening foods and beverages were present. The 
hurried pace and different work groups at the conference, however, 
did not allow very many people either to meet at the same timB, or 
to meet for long. Much of the benefit of such a break was thus 
lost because of the ever-present spectre of 'Tather Time" with one 
hand holding the crowded schedule and, vfith the other, a stop" watch 
ticking off the precious minutes designated for "relaxation" and 
relief J 
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General Session I (Monday Evening) 
Major Purposes 

The four major purposes of this first meeting were to: 

a. welcome participants and open the conference. 

b. provide civic legitimacy to the conference through traditional 
patriotic rituals such as religious invocations, pledge 

of allegiance, and singing of nationalistic songs. 

c. present the crucial problems of citizen education for the 
next quarter century through two talks by Robert Coles 
and Frank McClure. 

d. set the tone for the conference, provide information on 
the overall conference schedule and activities, and 

set the stage for the first work group session later in 
the evening. 

Specific Observations 

Dr. Coles was provocative, challeriging,and irritating at the 
same time as he was aimless, wandering, and boring to the evaluators.* 
Mr. McClure, while perhaps providing some "black legitimacy" for the 
conference, presented no clear message to the audience, gave us 
a rhetorical laundry list of problems, and was an even less effective 
speaker.* The greeting provided by Dr. W. Phillip Hefley for 
participants seemed to be an afterthought and was rushed, with in- 
sufficient time provided for a walk-through of conference activities, 
techniques, procedures, and goals, and may have contributed to the con- 



^Indicates frequently mentioned response. 
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fusion evident in the subsequent work groups when the unfamiliar 
Delphi form first appeared.* The traditionalism of the conference 
format soon became evident when the Boy Scouts (up long past their 
bed times in some instances) posted the colors, and an all-white choral 
g^roup from a local high school sang a series of patriotic melodies. 
Some e valuators found such activities to be overbearing, boring andl/or 
counterproductive* - although one was quite enthusiastic about them. 

General Observations 

From the dinner onward the pace of the conference was set - 
hurried, crowded, full, and yet incomplete. The opening session pro- 
vided the classic contrast.. .''between rah, rah middle Americanism 
with flag waving, versus an attack on traditional citizen education 
attitudes - it showed how far we have to gol Yet these contrasts 
were helpful, if disturbing". The opening session was too long 
and allowed the already tight schedule to slip. 

Suggested Improvements 

The following suggestions were offered for improvement of " 
the opening sessions: 

a. cut the registration time - start all three initiatory 
activities earlier and finish them earlier. 

b. omit the invocations and patriotic rituals - one keynote 
talk is enough.* 

c. have only two speakers - a kick-off speaker (e.g.. Secretary 
Mathews ) and a "nuts and bolts", organization speaker. 



*Indicates frequently mentioned response. 
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(e.g., Commissioner Hefley),* 
d. omit a formal, banquet type dinner* or use cafeteria or 
buffet style instead. . 

General Sessiui II (Monday Morning) 9/21/76 
Major Purposes 

The primary purposes of this presentation were to: 

a. review the history of citizen education in line with 
the conference objectives. 

b. show that civic education has been an issue of major con- 
cern in the U.S. for 200 years. 

c. allow work groups to reflect on current themes and efforts 
in citizen education in contrast/conc?rt with the past. 

Specific Observations 

This presentation by Professor R. Freeman Butts suffered from 
its early morning schedule, since history and one's morning coffee 
make an unusual mixture. The poor lighting, the early morning chill, 
and the weighty topic distracted from this scholarly presentation. 
The chronological presentation did not allow for presentation of 
citizen education activities and functions and the stress was on the 
formal substance, rather than the major themes, of citizen education. 

This speech was well received by the evaluatora, who believed 
it to be an "excellent contribution "well organized and clear," 
a "succinct, articulate and sound" talk which was "interesting, 

♦Indicates frequently mentioned response. 
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informative and relevant."* Most of the audience, despite the early 
morning hour, was quite attentive; and the speech referred to the 
major problem areas in the U.S. thoughout. It was "right on the 
mone^" Dr. Butts was an able, personable, and effective speaker 
who knew his topic and had much to say for other citizen education 
efforts, as contrasted with the young Mr. McClure, "who should have 
stayed in Texas*" according to one observer. 



General Observations 

The focus of this talk may have been too narrow, in that the 
historical view could have been made more socio-political and broadened 
to include citizen education processes and activities, the family, 
work place, community, state, etc. However, since two-thirds of 
the listeners were from the education/governmental sectors, the talk 
probably suited audience interests. The attendance level was 
good for such an early morning session. 

Suggested Iirprovements 

"Light up the hall and the speaker and heat up the place - change 
the time to 9:00 a.m. to inprove attendance and attention level.'"* 
Provide for question and answer periods for this and all other 
presentations.* Since this was a historical paper, it could have 
been reproduced and distributed prior to the conference;* and the 
speaker could have summarized it and talked of other things, such 
as the relationship between the historical view and this conference. 



♦Indicates frequently mentioned response. 
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It would be helpful to offer a few lines of introduction for each 
speaker, despite the printed thurribnail sketches. And one evaluator 
contributed this observation; "provide patriotic, wake-cp trweici" 

General Session III (Tuesday Morning) 9/21/76 
Major Purposes 

The purposes of this meeting were to: 

a. relate the crucial problem areas previously discussed in 
the other activities to the major sector areas in citizen 
education (home, mass media, education, etc.). 

b. provide a contrasting liberal/conservative view for use 
in work group discussions. 

c. provoke a dialogue between representatives of different 
philosophical interest groups and thus challenge some 
conference objectives. 

Specific Observations 

The "dynamism" and "concern" of both Dr. Michael Scriven 
and Mr. William F. Buckley, Jr., were evident to one evaluator. Another 
said that Dr. Scriven related to the problem and sector areas whereas 
Mr. Buckley did not. Adjectives applying to each respectively were: 
Scriven, "right on target," "surpassed expectations," "interesting, 
informative and challenging," and Buckley, "too casual toward topic," 
"an incomplete and cheap shot presentation;" and for both speakers, 
"elicited strong participant reactiona ," "more two separate lec^jes^, 
not an exchange" and "an interesting contrast between the conservative/ 
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individual freedom and wrcDng is not to be tolerated viewpoint as 
versus the liberal educational innovator's viewpoint of citizenship, 
ethics, and morality." One evaluate r added that the hotel staff 
members who arrived with the water pitcher, glasses, and the American 
flag in the middle of the presentation provided "a nice Kansas City 
touch J". The "powerful personalities" of both speakers could not fail 
to impress, 

Buckley ignored the topic, except for a few links between the 
right/ethical/free/ religious issues. Scriven reduced the problem to 
elements of decline in ethics/morality, new media usage, withering 
away of the family, new types of crime, and educational deterioration, 
which he linked with waning national autonomy, population growth, 
government incompetence, and a new ethnicity and ethics.' Buckley's 
cost-benefit was poor when compared with Scriven. Scriven' s attack 
on the CCSO's model of citizenship (rationality and action) was 
significant. He proposed understanding and teaching about things - 
not forcing action - while maintaining 'that understanding precedes 
action. He said that the cognitive approach precedes affective arid 
behavorial changes and is the only legitimate way for citizen 
education. Not only are the CCSO objectives too traditional, 
according to Scriven, but he maintained that the most dangerous 
element to citizen education today is local control of the schools. 

General Observations 

The worth of this session, according to one participant-observer, 
was judged by the work group Is abundant use of the presentation in 
the subsequent session. The two talk^ provided a useful contrast 
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between the individual choice and group socialization goals of citizen 
education. Scriven^s emphasis on individur^ development and diversity 
was a highlight of the conference and should hava been reinforced, 
Buckley should have stayed and accepted his challenge and that of 
the participants instead of running off to catch a -^anje. "This was 
not $3,000 worth of Mr. Buckley - at least 'Dear Abby^ had the guts 
to stick it out later - as bad as McClurel" Buckley was strongest in 
his link between government/business, labor and liberty ^saying the 
primary secular value was human freedom. Scriven said the citizen 
education curriculum was obsolete and proposed the study of growth, 
economics, global perspectives, crime, family, media, communications, 
law, ethics and religion, and the principles of, and alternative to, 
American government. But since Scriven was so future oriented, he 
should have appeared later in the conference. 

One evaluator noted that the presiding official cited the fact 
that this was "Constitution Week" and that it was also "significant 
that the flag was posted in the middle of the debate - late, but 
ever present!" 

Suggested Improvements 

Provide more time for audience interaction with presenters and 
for speakers to interact with one another*. Ensure that all speakers 
have properly planned their time schedule and are committed to the 
conference and their role - there was no excuse for Buckley running 
off.* More time should be allowed for such controversial speakers - 



*Indicates frequently mentioned response. 
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allow them to sit in small groups with working members. Since one 
speaker seemed to have "ripped off" the conference, he could have 
just as well been taped and presented to participants differently. 
Provide for all preparations (including setting up for the coffee 
break, heating, lighting, water, and flags) before the speakers 
start.* Also, the room itself was not esthetically pleasing and the 
icoustics were very poor. 

Ceneral Session IV (;u:.iciay Afternoon) 9/21/76 , 
Major Purposes 

The primary purposes of this presentation were to: 

a. point out the current problems and deficiences of citizen 
education. 

b. relate citizen education to the schools and the mass media, 
particularly television. 

c. suggest means for improving citizen education. 

Specific Observationg 

Since Dr. B. Frank Brown was ill aid not present, a substitute 
speaker presented this talk without comment or interaction in a 
rhetorical vein. The content of the paper was significant aid well 
documented. The statistics on television usage and the fact that 
we have no national civic education program for television were both 
well made points. The paper also made some interesting, if well-known, 
points about lack of discipline and crime in the schools and flailed 
away at the physical education teacher who supposedly is still teaching 



♦Indicates frequently mentioned response, 
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civics, also asking that citizen education be taken away from him 
and the social studies teacher. More emphasis on school self governance 
by students also evoked some discussion, as it always does, if nothing 
more. Frank Brown ♦s laundry list of other problem areas (powerlessness 
and alienation, racism, sexism, inperialism, institutional disrespect, 
inflation, energy crisis, anti-traditionalism, student unrest, and 
of course the CIA, Watergate, the bureauracy, and the multi-nationals) 
provided the participants with reminders of our collective sins. The 
indictment of the schools for providing distributive, driver land 
drug education rather than moral and civic education leads one to 
wonder if the surrogate speaker or Dr. Brown really understood the 
difference between civics or citizenship education on the one hand 
and political or citizen education on the other. 

General Observations 

This talk illustrated the need for more balance between pro- 
blems and deficiencies on the one side wd strengths of citizen 
education on the other. The link provided between alienation, 
non-participation, and deficiencies in citizen education was a tiseful 
contribution. The need to identify a core curriculum for citizen 
education and a new definition of citizen education became apparent. 
This indictment of the civics teachers for deficiencies in their 
training or certification is less well grounded in research than is 
their unwillingness to teach morality. Lack of formal training may 
be less important than willingness to risk an open discussion of 
moral issues in the classroom toward the development of democratic 
values. 
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'Ajqqested Idprovefnents 

Duplicate and distribute the talk If a speaker does not show up; 
or else provide a useful substitute speaker or other constructive 
use of the time, such as giving more time to the work groups or more 
free time to the participants. Tape Frank Brown, sick or not, and 
have all the conference papers reproduced before the meetlngj 

General Session V (Tuesday Evening) 9/21/76 
Major Purposes 

The objectives of this presentation were to: 

a. present views on the U.S. as a national community with global 
perspectives. 

b. allow Secretary Mathews to give his perspectives on the 
conference as a whole and to lend his authority to achievement 
of conference objectives. 

c. as threatening problems arise, allow time for the conference 
coordinator to present them for discussion during plenary 
session so that immediate corrective action can be taken 

. with the consensus of participants. 

Specific Observations 

The HEW Secretary showed his intsrest in developing a new con^ 
cept of citizen education. He was ^'good medicine'* for those who 
think all high ranking governmental officials are a sham. The 
Secretary defined his concept of citizen education C i.e. , certain 
knowledge objectives and beliefs leading to individual participation 
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and governmental action) and redefined HEW tasks as a subset of total 
governmental redefinition of public tasks, officials, ^nd agencies. 
Most Interesting were the general statistics on the enormity of the 
HEW enterprise: 330 programs and 140,000 personnel, spending 
140 billion dollars ainually, or over one^fourth of the total federal 
budget. The Secretary's stress on the fact that civics is taught 
as a "spectator sport", and the need for increased citizen psrtici* 
pation, came home to the audience. 

General Observatione 

Our evaluators thought the Secretary's talk to be helpful, 
although evening sessions at the end of a busy day are not occasions 
for deep thought. The one criticism mentioned was that he did not 
address his assigned topic, "A National Community with Global 
Perspectives". Rather, he chose to describe HEW's role in fostering 
citizen participation through citizen education. The presiding official 
also antagonized some of the "female caucus" members, who did not 
appreciate his off->handed (condescending?) characterization of one 
female participant on the platform aa a "pretty" repreaentative of 
her sex in lieu of her given name, which he had forgotten. Thiai in 
addition to hla lengthy introduction, "turned off" aome of the 
eji/aluatora and the audience and proved counterproductive. Since the 
participinta were either tired or tiring faat, they did not make the 
beat audience; indeed th'ty had accepted their inactive paaaive/recipient 
role aa an audience at theae banqueta« Dr. Hefley'a obaervationa 
Old proiraaea were thought to be, reapectively, innocuoua and written 
on the wind. 
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Suggested Improvements 

Much agreement centered on having Secretary Mathews appear 
earlier in the conference. As one observer said, "Bring in the 
biggies on the first day!" or as another said, "This was a kick 
off, not a mid-point talk!" A third observed, "His charisma would 
have been more transferrdble on the first day!". As for the conference 
coordinator's role, he or she ought to perform a periodic accounting 
rather than a mes culpa role, based on participant feedback with 
carry through/implementation of suggestions as soon as possible. 
The presiding official's role ought to be better defined, to emphasize 
short introductions, humorous, pointed, or poignant observations; and 
a low-key approach. 

General Session VI (Wedneeday Morning) 9/22/76 
Major Purposes 

The objectives of thie talk were tos 

a. discu3s "alternatives" in citizen education. 

b. challenge some basic assumptions of the conference^ 
raise intellectual vision, and improve constructivs 
intarrelationahipe and undera tendings. 

c. project the image of the apeakar aa an "outaider*' or 
"alternative citizen" and a apokaaman for thoaa not 
preaent or even invited to the conference. 

d. aak baaic identity queationa auch aa "Who am I?" and "Are 
we the people?". 
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Speciflc Observations 

The speaker. Professor Bad! Foster, used his personsl observe* 
tions, rsther than s citizen educstion curriculum or forrasl program, 
as a guide for questioning the conference questions. He presented 
process and substantive questions about the sii>Ject, such as "Who, 
whst, when, and where are we?" The talk was very well received.* 
Like Dr. Mathews' talk, it was also low keyed and non-threatening, 
if aubtly challenging. Other remarka follow: "auperb speech - 
excellently delivered, powerful^ "right on tsrget for s definition 
of citizen education which was estsbllshed, defined, and implemented" 
in the talk; "the common problems of life for all were discussed - 
e.g., awareness and compassion ss well as the relevance of guiding 
questions, not final answers/' "an excellent presentation of the 
polarities of citizen education goals -integrative versus divisive^ 
trust versus alienation, distance versus closeness, involvement versus 
spectatorship, and participation veraus alienation." 

General Observations 

This was an appropriate mid-point challenge. The talk was 
succinct, direct, and understandable. The audience was attentive 
and interested in the vital questions raiaedi such ss who had been 
invited, who came and why, who did not come, and whom do we re- 
present? One observer thought this the most substantive, well- 
developed, and best presented talk to this point in the conferencei 
whereas others said the talk may hsve Iscksd substance snd raised ^ 
more questions than anawers. 
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quqcaested Improvementa 

No criticism was raised of the "breakfast talk" scheduling 
or other such matters. Inatead, there were other comments in* 
dicating that it could not have been inproved, and that this was 
one of the moat effective presentations yet heard. On two points 
only - the need for exchange between the speaker and participants 
and the requeat for one tentaUve anawer to at least one question 
about citizen education • were suggestions made for improvement. 

General Session VII (Wednesday Afternoon) 9/22/76 
Major Purposes 

This talk aimed to: 

a. discuss how citizen education can be improved for youth. 

b. relste the topic of citizen education improvement to the 
conference as a whole.. 

Specific Observations 

An excellent,. clear, and organized presentation by Or. Howard 
Mehlinger on all major sactorst school, family, media, etc., was 
well-received by an attentive audience. His point that citizen 
education Is not problem solving , any more than driver education 
is a problem to be solved, was wiill received. The call for education 
in ''reading, 'riting, 'rithmetic, and responsibility" although not 
new, was also appreciated , as was his case for fostering a strategy 
for grass roots reform of citizen education through formation of a 
national professionsl association of citizen educatore. 
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General Observations 

This talk presented an excellent summary of the educational 
impact of television on citizen education for all levels. It is 
surprising that it was so well received, since, "the audience 
looked beat". 

Suggested Improvements 

No substantive suggestions for improvement were made, except 
the usual ones to the effect that formal talks should be duplicated 
and distributed, the speaker should say something different than what 
is written, and that more speaker/audience interaction was needed. 

General Session VIII (Wednesday Evening) 9/22/76 
Major Purposes 

The' major objectives of this speech were to; 

J" 

a. relate citizen education to larger societal purposes 

b. "induce inspiration y*' according to one observer. 

Specific Observations 

The speech by The Reverend Jamea Jackson was very well 
received. In the words of one evaluator, it was. a '^tremendously 
Inspiring call to arms in the fight agalnt stifling mediocrity amJ 
decadence.'* Jackson's plug for his own PUSH program did not inter- 
fere with his topiC since the two were interrelated. His indictment of 
the perversity of some "pop" songs purveyed by disc Jockeys hit home 
to everyone concerned about children. 
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General Observations 

The quotation, "I loved it/* from one of our observers, sums 
up the audience reaction. This oration, in the finest sense of the 
word, stressed self-sacrifice, personal discipline, and self-determina- 
tion to achieve - all "old fashioned" American values which were not 
being enphasized in our formal or informal education system. 

Suggested Inorovements 

No other suggestions were offered, other than that this could 
well have been the first presentation. 

General Sessions IX and X (Thursday Morning) 9/23/76 
Major Purposes 

The objectives of these presentations were rr^: 

a. present a* viewpoint on how citizen educ^Uur could help 
resolve some' of the crucial probler* iri^aB. 

b. summarize some fiiSdings relevant to oiti/c:;^ . ducation from 
the national assessment findings ari j t.lw fX)r' .rence Delphi 
results* ' j . ' 

c. summarize work group findings, citizeh education problems, 
objectives and next steps, and 

d. diPC'::j3 a national policy for citizen education in the U.S. 

S pecific Observationa 

{» 

The talks by Ms. Abigail Van Buren ("Dear Abby") was largely 
dismissed as being either irrelevant or in poor taste fo;- a conference 
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such sa this. She was also labelled as being unrepresentative of 
professional women involved in citizen education However, her 
points regarding the poorer basic writing ski.-.n of her correspondents 
was of some significance. The national assessment findings by Dick 
Hulsart, although excellent, came too late Vj [je of uae for a conference 
input. There was not even an attenpt at a ^iral conference summary 
which, at this point, might have come off bacL'wy. Only the talks by Mr. 
Richard Hulisart and Mr. Logan Sallada (oi^ m:T/ional policy objectives) 
received above average grades, as did th^t by Dr. Terr.:'. Bell 
( attendance was about 50 persons) on morality ^jnd ethics and citizen 
education. The Delphi results were intere:binc' a'*!^ uay be useful 
for other conferences. Marginal notes by partic:t;jiiitti regarding the 
"constructive frustration" of the work groups and the enforcement 
versus le adership roles of the USOE also bear wntion. 

General Observations 

Mr. Sallaria's discussion of conB*?nsus versus risk goals in 
citizen education, and his putting together the pieces of the con- 
ference puzzle (in tern» of Office of Education interests, use of 
the Delphi process, etc.) helpea to provide some much needed unity 
for the conference. Thio presentation was labelled '^excellent, 
succinctt clear, poignant, and substantive". The provision made 
for the reactions of general participants and staff members was 
one of the few opportunities for interaction between those on the 
podium and those in the audience. Participants finally were given 
nn opportunity to talk about the conferenpe to the fast-dwindling 
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(about 110 persons) group. Representatives from different projects 
and activity groups also had an opportunity to deliver a "commercial" 
about their work as it .'..Jatea to the conference objectives. 

Suggested Improvements 

As with all the well* received talks, it was suggested that 
Mr. Sallada's speech would be better scheduled at the start of the 
conference. The visibility in the meeting hall, the acoustics, and 
the lighting were unsatisfactory; more time should have been allowed 
for the speakers; and Ms. Van Buren should have been replaced with 
someone more relevant to the conference concerns. Time for a more 
complete summary of conference outcomes and a pre-conference 
abstract of the national assessment results were also suggested for 
the format of future conference. Provision for participaits to 
deliver their "commerrlals" should have been allowed earlier 
in the meetings. The discussion of Delphi process/results could 
also have been shifted to an earlier time in the meeting. 

Summary of Presentations 

The conference presentations and presiding officials seemed 
to be separated into the "bad guys" and the "good guys". The 
"good guys" had something substantial to contribute in the way of 
needed or significant information, emotional appeal » or bringing 
order out of chaos. The "bad guys" refused to relate to the sub- 
stance of the conference or the underlying process, while "doing their 
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own thing^and putting on their standard act. The same criticisms 
applied those who chaired the various sessions. Since this is not 
the place to list those who did or did not "make it", we leave it 
to perceptive readers to decide for themselves just which of the 
presenters belongs on which list. 

The Work Groups (Monday Evening-Wednesday Evening) 9/20/76-9/22/76 

Twenty work groups met for five separate sessions of 60 to 90 
minutes duration. This summary has sanpled five of these twenty 
work groups as being representative of the whole. The members of 
the evaluation team used Form #2, Participant Observer's Evaluation 
of Citizen Education Meeting (see Appendix V) to evaluate the group 
se& >lons in a uniform fashion. 

Major Objectives 

The principal purposes of these work sessions as seen by the 
participant observers were to: 

a. develop a common definition of citizen education. 

b. provide a foundation and the principles for a citizen 
education curriculum. 

c. achieve the conference objectives, including the aims of 
the Delphi process.^ 

d. serve as facilitator and channel for information from 
states and localities. 



^Indicates f rsquently mentioned response. 
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e, recommend problem areas for study and suggest appropriate 
sectors of response for citizen education study and • 
techniques, 

f, help participants realize the magnitude and many dimensions 
of citizen education, 

g, help group members understand the goals of citizen educa- 
tion and the conference itself. 

Strengths 

The observers saw the following items as strong points of 
the groups: 

a, the group was diverse in sector representation and 
tenperament, 

b, the facilitator encouraged free exchange of opiniona, 

c, group consensus was soon arrived at regarding method 

of proceeding as well as the fundamental principales and 
questions for citizen education, 

d, the groip helped participants to sense the inportance 

for all sectors of society of overcoming aemanticand other 

basic problems of citizen education. 
0/ the leaders helped members to recognize problems snd 

alternatives and to work on substantive issues, 
f . the qvoip process coincided well with conference objectives. 
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, Weakneases 

The evaluation team saw the following as weaker features of 
the groups: 

a. the formal structure irrposed by the Delphi process met . 

with immediate group resistance which hindered group proceases, 
b« the conference planners made no provision for variations in 

group approachea. 

c. much time waa waated on the painful process of abandoning 
the miaunderstood Delphi technique. 

d. the group did not accomplish its objectives since there waa 
not enough time to do ao« 

e. late evening is the wrong time to begin a group seaaior) 
or to have a group meeting during the conference. 

f . not enough time waa allowed for exchange of information 
or for discussion of major presentations.* 

Specific and General Observations 

The evaluatora alao had aeveral general commenta to make: 

a. the group ignored the Delphi format and problem aolving 
format early, in order to achieve its aims/goals. 

b. the groip did not prepare its own list of citizen educa- 
tion problems, iaauea^ and reaponaibilitiea. 

c. effective and inaightful leadership displayed by the 
gro'jp Jeadera was responsible for group successes. 

d. titt^ rjroup stressed development of individual citizens by 

^Indicates frequently mentioned response. 
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arming them with information and analytical skills for making 
inforojal decisions in their roles as citizens, 

e. only the personal empathy and conpassion of leaders maintained 
group momentum throughout the conference. 

f. this was 'bne of the most aimless, unstructured, rudderless, 
and ineffective groups I have ever attended; it was sheer 
chaos and s waste of time." 

g. several of the facilitators wore flags, MCP ties and the 
like which were quite appropriate for a conference in Kansas 
City, according to more than one team member. 

» 

Suggestions for Improvement 

Several suggestions for improvwnent were also offered, to include 
the following: 

a. if the Delphi technique is used again, ssk groups to respond 
to/ define/discuss the list of problems first; then consider 
participants' prior rankings of those problems and issues; 
finally, reach agreement on s new revised list with rankings. 

b. a clear explanation of the entire conference process, in- 
cluding the purposes of work groups, is needed at the start 
of the meeting.* 

c. provide conference participants with several options or 
styles for group problem solving. 

d. ensure that all participants have input into the Delphi 

♦Indicates frequently mentioned response. 



81 



findings, if used in a group setting again,* 

e. during the first plenary session, discuss the role of 
the work groups within the overall conference plan. 

f . select participants for work groups, on the basis of 
qualifications, interests, motivation to achieve, etc. 
(Just how to do this was not specifiedi) 

g. better training of grotp leaders is needed, since they must 
combat tough time schedules, apathy, and misconceptions 

of the conference as a whole. 

Summary of Work Group Observations 

As one observer said, "I learned something in spite of the 
problems. I enjoyed the experience and, with modifications, stand 
ready to try it again." This was a typical response indicating 
mixed reactions to the work grotp experience. Much of the success 
of the meeting depended on the leaders and the quality and mix of 
participants in the group. Since the work groups took up approxi- 
mately one full day, or one-third of the conference schedule, it ie 
ifipetative that they be well staffed end led. Better selection and 
training of facilitatcrs/hosts should be a prime concern of future 
conferences, as should be the provision of clear objectives for 
each group with a flexible format and schedule to fit group interests 
and needs. More early movement from group to group might be allowed, 
as well as improved matching of participants, perhaps by sectors. 
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The Special Activity Groups ( Tuesday-Wednesday) S/ll/lS'-S/ll/ie 

There were four concurrent sessions, each about 90 minutes 
long for seven special activities. Five different special-activity 

sessions were monitored on several occasions (political v /articipation, 

«... 

ethics, economics, multi-ethnic, and law related) by the conference 
evaluators. (Actually, all seven special activities were monitored 
for all sessions by the evaluation team, but written records were 
kept on five of the seven). These observers also used Form #2, 
Participation Observer's Evaluation of Citizen Education Meeting 
(see Appendix V), to evaluate these sessions in a standardized manner. 

M ajor Objectives 

There were several objectives for these activities; among them 
were to: 

a. relate two subtopics (political theory and political 
parties/partisanship) of political science as a discipline 
to the conference themes* 

b. provide overviews of the various subfields of citizen 
education (such as political participation, multi-ethnic, 
morality and ethics, and economics) to interested participants. 

c. introduce or reinforce the use of role playing »id other 
teaching techniques in the "new" social studies. 

d. disciss research findings, such as Kohlberg's moral stages, 
and apply them to educational practice. 

♦Indicates frequently mentioned response. 
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e, describe successful experimental programs underway in certain 
parts of the country.* 

f, present information on value clarification aid cognitive 
decisions, 

g. focus on creating a new civics through new goals, processes, 
and expectations for political education, ^ 

h. relate research on television as an educational and 
comfntni cations medium to the reform of citizen education, 

i« inform participants of the role of religious groups in 
ethics education. 

Strengths of the Activity Sessions 

Several strong points were also described for these sessions 
such as: 

a. much participant involvement in the activity, 

b. inspiring leaders, very practical, and very professional 
program. 

c. fine interrelationship between qualified leaders/speakers 
and their audience- leaders; •borapetence,'"power, •'•feeling," 
and't^ersonal qualitiesf* evident.* 

d. a real understanding of the materials and programs presented 
from an insider's point of view. 

e. presentation of much useful and interesting material in 
a short time, 

f . discussion of the school as a political unit. 



*Indicates frequently mentioned response. 
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g. use of novel ideas and technology for presentations; 
e.g.» videotape ^'sanplers.** 

Weaknesses of the Special Activities 

While there were strengths in the special activities program, 
there were also weaknesses, among them being: 

a. too much stress on the disciplinary elements of citizen 
education, using a boring lecture mode. 

b. not enough time - only weakness was that participants had 
to stop.* 

c. ••no weaknesses apparent."* 

d. projecls presented were too provincial and local could 
not be initiated, adopted, or adapted to use elesewhere 
with a knowledge that tney would work, 

e. poor grouping o^ two nationwide elementary and secondary 
projects with a very localized project in a "show and tell" 
session. 

f. participants were tired this late in the conference and the 
speakers were not dynamic. 

Roles of the Leaders, Panelists, and Speakers 

Observers were also asked to comment on the roles played by the 
leadership of the activity group, which they did as follows: 

a. leader used active/passive mode and was acceptable - 



♦Indicates frequently mentioned response. 
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provided some useful input into the session,* 

b. responsible for actively directing the program, ensuring 
that the time was used effectively* - good introduction 
and summary of session.* 

c. ensured time for questions, answers, and audience partici- 
pation. 

Suggested ImprovemBnts 

Several comments were made regarding inprovements in the activi- 
ties such as: 

a. the citizenship -participation and rational-choice objectives 
of citizen education in the political system need more 
discussion elsewhere. 

b. 'hllow more time.* 

c. provide round tables or c'vfferent seating arrangement for 
group involvement. 

d. avoid straight lectures which do not use handouts and other 
teaching aids. 

e. regulate/limit gronD size to a reasonable number - say 
35-40 persons, 

f. give handouts describing the project name, address, materials 
available, publisher, etcK 

g. eliminate the two sessions on political science as a 
discipline and, also, local "show and tell" groups which 

♦Indicates frequently mentioned response. 
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were too provincial: Allow people to sign 14} for 
special activities on a free choice basis, 
h. irrprove timing, speakers, and lecture methods,* 

Other Comments /Personal Observations 

This category of responses allowed participant observers free 
rein to make the following comments: 

a. this activity (on television and education) should be 
presented to the entire country I 

b. the first two very disparate and boring sessions - on 
education and politics — could bavj been eliminated, 

c. the ethnic group refers to 60 million ethnics; they are 
farcical in some ways, but know where they are going; 
they want to help society, but on their terms, 

d. useful models for citizen education and ethnicity are the 
New York state, Hleveland/Detroit/St. Louis, and India 
materials for ethnics and non-ethnic students and adults. 

e. the smaller political participation projects involving a 
few people belong at the regional, state, or local con- 
ferences - a network of these activities should be set up. 

f. some of the model materials and programs left gaps, e.g., 
the "slow learner;" but that is to be expected, 

g. why not one or two model programs for each new curriculum 
area on the conference program? 



♦Indicates frequently mentioned response. 
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Sumfoary of Special Activity Sessions 

Some of our observers were quite impressed Kith all of these 
activities, saying that they were, "excellefit informative" or 
"were of profound educ'ational v^lue to me as a pex-son''. The kay 
combination of^lements for an efrective program are; 

1, effective leaders/chairpersons, 

2, interesting and novel rc^^^as, information, materia ui d 
programs. 

3, involvement of participants ^ • .,he learning acti 1' /. 

4, school or educationally baserf rra^ .ials which have been 

trieJ out on many groups and c;.*e levals. *^ ^ 

5, soma chiance of foiltrtC^up or *?idJitiona J. contact with the 
project jjirectors and their m^eiials , either directly or 
^jo^ijgh a pWlishBr/distribCFEore » • 
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V. CONCLUSIONS AND RECOMKENDATIONS 



Throughout this report we nave provided the reader with section- 
by-sectiffn and part-by-part sutnma/les of the principal conclusions 
from each major division of tbe'^study. bur j)urpose here is merely 
to draw fipm those summary statements the major elements of our con- 
clusions and recommendations for thie plmning, organization, imple- 
mentation and foj.low-up activities for future USOE efforts in the 
citizen education field/ 

A, f^rincipal Concl usions • 

The following list of items repr;3sents our primary general 
and specific conclusions from this re"6earch ai r.ivity: 

1. -The Kansas *City conference ' a^.^tj^fied success in 
achieving some of its objectives. 

2. The average conference participant was satisfied with 
Jthe conference a whole, because it produced personal benefits. 

However, certain features of the- confei'ence were grossly de*-- 
fective (e.g., inadequate statement of conference objectives, 
imperfect application of the Delphi techniq'*e, irisufficient 
treatment of state and local government concerns, inequitable 
sector rep tq gpi ot ation, no evoffition of a "game plan" for citizen 
education, overstructuring of the conference, lack of definition 
of the inteJfcJed 9€bpe pf the conference dnd of its design for 
the accomplishment of conference objectives). 



3. Significant minorities at the conference believed that 
cteficiencies they noted in the conference format could have been 
corrected on the spot and were not. They also perceived serious 
inadequcies in pre-conference information, invitations, the 
coffee breaks, the conference communications system, printed 
resource materials, and the balance between theory and spplica- 
tion. 

4. Large numbers of those present at the conference wanted 
some time for socializing and relaxation, as well as for work 
groMps, special activities, and '^oth formal and informal inter- • 
ction with major speakers" and conference leaders. 

5. A substantial number of participants wanted improvements 
in the work groip process and in the selection of the facilitators 
with whom they were obliged to work so closely. 

6. Significant nurhbers of participants were dissatisfied 
with certain of the major presentations (discussed previously 

in great detail), as well as with certain portions of the special- 
activity sessions. These features of the conference warrant a more 
' careful review. 

7. The conference objectives planned by the leadership were 
perceived differently by participants in terms of substantive 
content, emphasis, procedures , and processes. There is need for 
hard work on this critical aspect of conference maiagement. 

8. On balance, the conference partially achieved its objectives 
of sector representation ^ith two sectors, education and government, 
overrep resented); identification of key issues in public and civic 
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education; and review and listing of problems and deficieiicies 
in citizen education. But it did produce a significant list 
of recommendations for action or of useful findings for subsequent 
conferences (unless a rigorous reworking of the Delphi results, 
the work group reports, and these evaluation data are included 
as output measures! X 

9. The external conference evaluation produced an alternative 
list of objectives as perceived by the participants, which may be 
even more useful for future conference planning than the pre-conferen 
objectives described in this report, 

10, The principal features of the conference which proved 
troublesome are fully discussed above, but are here reiterated 
for review pruposes: overrigorous structure of program and work 
groups; too long and full working hours; lack of free time for 
recreation and Visiting"; inadequate and unsystematic attention to 
critical problem areas with too much process and paperwork, 
and no substance, e.g., the Delphi; defects in the recruitment and 
invitation process which produced insufficient sector representation 
as well as inadequacies in the numbers of prnfesFional women, 
minorities, and special interests; too formalized presentations 
with some inaccessible, unrepresentative, and irrelevant speakers 
who frequently ignored their topics; inadequacies in some 
facilitators' handling of their groups; and, finally, communication 
deficiencies which occurred before and during the conference re- 
garding poor information exchange, unclear objectives, and little 
attention to cross-communications and information retrieval and 
sharing. 
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11. The lack of a clearly and widely known focus and 
strategy for Kansas City had a domino effect on other features 
of the conference in that support personnel (e.g., presenters 
and resource persons) did not know how their efforts would fit 
into the overall scheme of things. 

12. There was considerable evidence of resentment toward, and 
mistrust of, "government" and federal bureaucrats. Many partici- 
pants linked the overstructuring and use of forms at the con- 
ference with the excessive influence of the Washington and Kansas 
City USOE staffs.* 

13. Participants' comments indicated that there was obvious 
distrust of the conference sponsors; and many believed that they 
were there iierely to ratify, in rubber-stamp fashion, p re-determined, 
hidden agenda. 

14. Throughout the conference there were "bad vibrations" and 
feelings of emotiooal hostility with the participants developing a 
sense of a "we," (the "innocent," "well meaning," "open," 
"democratic," "friendly," "practical," "willing," "manipulated," 
etc. participants) versus "they" (the "devious," "authoritarian," 
"bureaucratic," "manipulative," "closed," "routinized," "un listening," 
"hostile," etc. staff of conference planners and organizers).* 



♦All items marked with an asterisk are based on a post-conference meeting 
between the evaluators and the Citizen EJucation Staff in Washington, 
D. C. A summary of these observations is available from the evaluators 
or from their tttizen Education aaff, USOE, Washington, D. C, 
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15. The Delphi process became the focus for participant 
resentment, distrust, and anger discussed in items 12, 13, and 

14 above, which hostility in turn was reinforced through repeated 
reintroduction of the Delphi results and forms through two-thirds 
of the conference. Explosive relief or cverreaction within 
work groups by "chucking the Delphi," and "doing one's own thing" 
was one device frequently used to relieve frustrations.* 

16. The emotional distance between "us" and "them" spilled 
over to other facets of the conference creating a sort of domino 
effect. 

17. Participants also opted or dropped out of special activity 
sessions, not because of their limited worth, but because of the 
expressed need for some time to oneself to "satisfy one's personal 
needs."* 

18. Both the selection of participants and their mix in work 
and activity groups produced a counterproductive ambience in these 
groups, since many were poorly motivated, hostile, dominant and/or 
anti-establishment.-^ 

19. The facilitators themselves (in part because of defects 
in the selection and training processes) were hard pressed to 
handle the difficulties they faced with the program: the 
diversity of their groups, frustration with the Delphi, counter- 
productive role conflicts, such as being identified as an "ivory 
tower" educator dominating the interaction of a groLp which in- 
cluded "practical" businessmen, or being tagged as a repr :ent.4"ive 
of the conference "establishment" (and therefore suspect). 
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20. reference leaders also succumbed to the ''armed camp" 
phenonmenon when they had to defend their bastions against the 
attacks of the "barbarians" (participants) who did not seem to 
understand what was "best" (i.e. planned) for them or what was 

at stake here for conference managers in terms of "loss of face" if 
the predetermined plans were aborted. 

21. Certain basic features of the conference lent credence to 
certain participants' charges of WASP dominance and of not-so- 
subtle sexism, racism, class and sector biases, and other destructive 
divisiveness. A half dozen groups broke away from any identifi- 
cation with the larger citizen education/conference community for 
the sake of long-standing private concerns and interests which 

were presumably more important - no lowest common denominator for 
the conference was ever reached. Compromise of differences, 
"the lowest of the goods and the highest of the evils," was never 
approached until the last day.* 

22. The "armed camp" phenomenon also spilled over into 
rivalries between the Washington and Kansas City USOE staffs with, 
for example, mutual distrust of each faction's leaders, btaff 
personnel, evaluation teams and even into different perceptions 

of the definition, objectives, and desired outcomes of the conference 
and of citizen education itself. For example, the conflict be- 
tween the innovative citizen/civic/participent or political 
education system, broadly conceived and defined for the one hand 
(the D. C. view) versus tK- more formal and traditional citizenship, 
civics, or passive governmental education system narrowly defined 
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(the Kansas City view) was never really faced. It remained un- 
resolved at the conference and gradually divided the conference 
into three groups - the committed, the unknowing, and the "enemy." 
The conference produced no unity, encouraged diversity, and fell 
short of unity in diversity, conpromise, or a common denominator 
for citizen/citizenship education,* 

23, The conference evaluation process, itself, was entangled 
into the"armed campJ^ mentality i.e. an internal versus an external 
evaluation team. Different groups of major or minor feudal educa- 
tional lords and vassals were allied with one camp or the other ^ 
until it was finally decided that a holy truce would be called for 
the last half of the conference. The external evaluation process, 
itself, suffered from this divisiveness as well as from its own 
inherent deficiencies of lengthy, curhbersome form, time for com- 
pletion, and other factors such as typographical errors and 
inaccuracies - most of them stemming from time pressures and 
erroneous advance information on which certain segments of tfie forms 
were based. The evaluators also should have had time for the 
schedule to explain the process, and time specifically set aside 
for participants to complete the pre-tested forms.* 

24. The conference as a whole may be considered a success in 
that it approached the totality of citizen education (with alJ its 
concerns and rinks in the open) and helped to raise the public 
consciousness level regarding the field. It was a useful "first 
try," providing valuable experience for planning future regional, 
state, and other national conferences.* 
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25. Participants valued this conference for several reasons. 
They were impressed with some of the speakers and what they had 

to say. Th-y welcomed this opportunity for the dialogue, contact and 
exchange of information and ideas with their peers and their 
"betters." The special-activities sessions were a definite asset; 
and certain of the work groups were quite productive and satisfying 
to participants. The highest priority, however, was the topic 
of the conference; indeed the topic was by far the most iirportant 
attraction to the attendees. Certain ccMiferees were also impressed 
with the different areal and sector representatives with whom they 
worked and talked. Their, horizons were mutually broadened, or 
so it appears. And some of those present - a definite minority - 
even complimented the strict, tight, and rigorous pace of the 
meeting which, apparently, came close to being all things to all 
people I* 

26. With all of this said, our overall evaluation of the 
conference is that it was a success, albeit a qualified success. 
Conference participants, leaders, planners, and evaluators were 
impressed with the enormity of the undertaking, as well as with 
the importance of its tasks and the sweep of its objectives. When 
one aims for t!.8 heavens and lands somewhere in between, the trip 
cannot be called a failure - except for under-achievement of 

one's own expectations. This was the first such national conference 
on citizen education ever held in the United States and that, 
itself, is a major accomplishment recognized by participants. 
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Success of the conference will be measured hereafter by what 
happens to citizen education across the United States, inasmuch 
as this conference was only one phase of a larger plan or policy 
for this vital aspect of our formal and informal educational 
system. 

Principal Recommen datioris 

Many of the signifxcant recomrrendations regarding the 
citizen education project in general and the Kansas City conference 
(and subsequent conferences) in particular have been mentioned in 
passing above. Here we shall present something of a laundry list 
of proposed "solutions" to the deficiencies noted previously — 
which itself a risky task indeed*. Our suggestions for improving 
coiiference operations include the following items: 

1. Improve the pre-conference planning process by stating 
clearly achievable objectives that are directly related to the con- 
ference inputs, throughputs and outputs. For example, if partici- 
pants are to use a lengthy resource book or other reading material 
during the conference, then they should receive this material and 
"reading assignment" prior to the conference. By the same token, 
an exposition of conference objectives and of conference design 
should be sent to all invitees prior to the conference. 

2. Schedule the conference agenda to allow for greater 
flexibility in accommodating participants' and leaders* suggestions 
and revisions during and after the conference. Be ready to 
discard or revise conference segments and plans as necessary to 
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ensure achievement of objectives, regardless of the amount of pre- 
planning time put into them. Provide time for periodic interaction 
and feedback between conference leaders and participants, to allow 
suggestions to be elicited, discussed, implemented, and evaluated 
as an on-going conference process. 

3. Allow enoujjh free time for participants and for 
participant interaction - both formally, through question-and- 
answer-periods, and informally, through such devices as an evening 
*'open house" or "free university" schedule for those interested in 
common topics, • 

4. Schedule fewer formal banquet presentations and "name" 
speakers; and be sure that each speaker not only addresses 

the topic, but also prepares a formal paper for pre- conference dis- 
tribution, summarizes the paper, says something else of significance, 
and interacts with the audience. 

5. Papers and "books" need not be commissioned for the 
conference, when a few short hand-outs and in-house papers would 
do. Recent speerhes, papers, and other materials on citizen 

education by Secretary Matheivs, former Commissioner Bell, Mr. Sallada and 
Mr. Lowe did not appear in the conference book of readings; nor 
were they distributed prior to or during the conference - although 
they niight well have been. 

6. Make definite plans for proper sector representation by 
invit q and paying for the expenses pf , or for papers from, 
representatives from different sectors of American society. 
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7. Improve the work - group and special-activity processes 

by better training of leaders, clearer definition of their objectives 
and roles, and experimenting with different methods of grouping 
persons, e.g., by sectors, sub-specialties, geographic areas, etc- 
As for special activities, cut the number in half; present those 
which have regional, state, or local interest to selected persons 
and provide for more systematic dissemination to all participants 
of basic information on what is [happening in each of the special- 
activity fields. 

8. Provide for better communications from one work group to 
another and from one special activity to another. Allow for free 
movement from grotp to group and for wider dissemination of what 
has happened and what is planned in the different groups, either 
orally or in print, 

9. Explain the conference goals, objectives, precedures, 
expectations, and ''game plan" at the start of the meeting. If 
the Delphi process is uaeJ, sharply modify its use by building it 
into the early description/discussion of expectations and by 
changing its name to "consensus survey."* 

10. Drastically revise the groi^D process by: splitting each 
sector into smaller groups or by constituting a cross section of 
representatives; adjusting the meal schedule to allow work groups 
to eat together; encouraging group identity and cohesion; asking 
groups to identify key questions or problem areas for their sector; 
and either allowing each grotp considerable latitude in its approach 
to attaining group objectives or providing more guidance with 
built-in flexibility. Partir . ^shts should be encouraged to attend 
all events, particularly the special activity sessions. 
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11, Better selectivity of participants and facilitators would 
irrprove the conference. Both should be aware of what they are 
getting into and should be given an opportunity to "opt out." 
The use of federal government staff as leaders ought to be reevaluated. 
Inproved sector, racial, ethnic, sex, economic class, youth, and 
other representation is a must for any future conferences discussing 
citizen education for the citizenry. The facilitators/leaders 
should also be better selected and trained. Participants should 
be ready to discuss the objectives proposed for their groups, and 
to reach consensus on the most productive and balanced route to 
follow in reaching them. * This information should also be shared 
from group to group. 

Facilitators should be qualified and motivated, and should "buy 
into" the conference. There should be "dry run" training sessions 
for group leaders during which group management problems are 
anticipated and alternative solutions proposed. In sum, facilitators 
should have the following five basic characteristics: 

1. demonstrated experience and success in managing small groups 

2. a clear understanding of group objectives 

3. an unequivocal personal commitment to reaching those ob- 
jectives 

4. a sense of how to keep the group "moving down the road" 
toward group objectives without being authoritarisn, and 

5. a permissive, but persuasive, approach in encouraging 
groip members to discuss group objectives and to adopt them 
as their own, although possibly in a modified form. 
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12. Provide opportunities for individuals to "sound ofP 
and "ventilate" early and throughout the conference, so that 
they are not preoccupied with their own special interests and 
with awaiting an opportunity to be heard. Participants should be 
treated as the leaders that they are, rather than as school 
children who have homework and busywork to do. A plenary session 
summarizing the accomplishments and recommendations of work and 
special activity groups and encouraging further commitment from 
conference participants should be scheduled on the last of the 
meeting. 

13. More careful attention must be paid to housekeeping de- 
tails such as quality of food, adequacy of meeting rooms, and 
other basic factors which, if inadequate, may diminish conference 
success. 

14. The schedule (or "parade," as one participant termed it) 
of conference speakers should be carefully planned to consider not 
only the topic for each talk, but other essentials such as the 
track record cf the speaker, his personality and dynamism, his 
reputation and pos .iiiin, and his basic raison d* etre at the 
conference. A dv ^ " speaker (e.g. Reverend Jackson) should kick 
off the conference, followed by a high ranking official (e.g.. 
Secretary Mathews) to provide legitimacy and commitment to the 
conference, followed by a prominent professional in the field 
(e.g.. Dr. Roberta Siegel, an expert on childhood political 
socialization, or Dr. Howard Mehlinger). A properly planned con- 
ference considers all the principal variables which a given 
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personality can bring to his substantive remarks From the platform 
(race, personality, reputation, gender, status, etc.). 
More than a logical/ developmental/formal program with significant 
questions is needed to produce desired outcomes. 

15. Questions of appropriate entertainment, religious influence, 
site^and accommodations for the conference (the second best hotel 
complex in Kansas City just will not do for a national conference 
when the rates are the same as the best) , and other such logistical 
and co-curricular functions need to be worked out long in 

advance and seen not only from the perspective of the local host, 
but also from that of a visitor to the city. 

16. Plans for a future national conference should also con- 
sider the following lessons from Kansas City; certain meals should 
be allowed away from the conference site; more local, state, or 
regional meetings should precede another national meeting; fewer 
banquet and formal speakers and more interactive work group sessions 
should be scheduled; improved p re-conference and in-session 
distribution of papers is needed; and participants' should be 
allowed to distribute their own papers (after all, even the editor 
of the resource book put his own piece on civics, however dated, 
into the conference record!). 

17. As a whole, longer segments of time to discuss the formal 
presentations and special activities and to complete work group 
functions are necessary preconditions for future success of any 
such conference. However, this must be a self-imposed time re- 
striction with a flexible schedule. Moreover, the rule should be 
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that only the most important temporal segments of the conference 
are predetermined, and the remainder are left for participants to 
decide according to their own judgement regarding the achievement 
of common objectives* 

18. Conferences often have internal and unwanted divisiveness 
among different categories of the invitees because of pre-existent 
and external factors such as race, ethnicity, generic and socio- 
economic-status differences. However, when external rivalries 
betwen differing sponsoring groups for a conference reach the 
critical and public level, then the route to a conference disaster 
is predetermined. Consequently, any future conference planning 
must iron out major differences among principals as to goals, 
objectives, and expected outcomes. For this conference, all 
important differences should have been reconciled between the two 
USOE offices regarding use of the Delphi instrument, training 

of facilitators, speaking arrangements, conference evaluation pro- 
cedures, and the like. Careful p re-conference planning must face 
and resolve this important source of potential conflict. 

19. Any conference director has suspicions about' whether or 
riot participants at "his" conference really know what is best 

for them. At this conference the high 'quality of the conferees was 
such that they needed to bfe consulted before, during, and after 
the event. For example, the folldwing is a typical example of a 
participant's summary view of basic effects and suggestions for 
improving this conference: 
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"In my judgement, the meeting displayed these weaknesses; 
1) lack of clearly stated objectives, (2) over organization 
(3) inappropriate use of the Delphi technique and (4) faulty 
recruitment techniques. .People should understand why they » re 
being asked to attend the meeting. The schedule should be 
flexible and allow sufficient time for informal interaction and 
discussion. An agenda focused around basic questions of concern 
to all participants should be substituted for the Delphi tech- 
nique. Individuals who are actively involved in civic and 
community programs should be itentified and invited to partici^ 
pate." - , ^. 

One can ignore this kind of excellent feedback only at his 
peril, unless he is willing to repeat mistakes of the past. 
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VI. EVALUATION OF THE DELPHI PROCESS; 
A SPECIAL CASE STUDY 

« 

What F\jEpo3e3 Could the Delphi Have Served ? 

The great casualty of the Kansas City conference was the Delphi 
process. Before we disndss it out of hand, however, we must ask 
ourselves: "Did the Ddphi receive a fair trial?" It is the 
evaluators' assessment that it clearly. did not. The Delphi process 
could have served the following invaluable purposes: 

1. enabling participants to "buy into" the conference well 
in advance 

2. encouraging them to give hard, serious thought to problems 
and issues of citizen education 

3. getting them to organize and articulate their thoughts on 
paper, through identification and ranking of problems and 
issues as they saw them, and 

4. strengthening their sense of identification with the con- 
ference, through the knowledge that their contributions 
would be used at the conference to further conference 
objectives. 

What Actxjtaily Happened? 

Why did the Delphi process not work out the way it was planned ? 
Wxf did it fall short of its potential? There are at least eight 
principal reasons, all of them instructive: 

First, the Delphi instruments were mailed during the summer months-^ 
perhaps the worst possible time of year to get mail to recipients, to 
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require hard thinking on difficult subjects, and to elicit a mail 
return. To prove the point, of about 1,000 instruments mailed to 
participants, 125 had been conpleted and returned by conference time, 
a very low response rate of 12.5?i. In early September a different 
Delphi instrument, based on returns from the mailing to participant^, 
was distributed to 250 experts in citizen education. The response 
to this mailing was somewhat better: 44 were returned for a response 
rate of 17. 6S, 

Second, no more than 1,0D0 participant instruments were cir- 
culated although about 2,000 persons were invited. Thus, at least 
half the invitees never saw the instrument. Somewhat more than half 
of the actual participants nad apparently seen it; we have no count 
of the true number. We do know, however, that there were about 360 
active participants at the conference. If we assume that this nurriber 
included all 125 who had returned their Delphi surveys, then it is 
evident that only one out of three of those actively participating 
had conpleted a form. 

Third, this 50S ratio applied to work group facilitators and 
host recorders, as well. The training session for these key personnel 
on the Monday morning preceding the conference was proceeding 
superbly until someone asked, toward the end of the first hour and 
a half, "What's a Delphi?'! With this question, the smooth flow of 
the meeting was essentially derailed, though only temporarily. The 
trainers responded as well as they possibly could have by: 

a. explaining the nature, history, purpose, and process of 
the instrument 
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b. explaining what the Delphi was, what it was Intended to 
do, and how it was being applied to serve the objectives 
of the conference. 

c. reading the participant instrument in its entirety 

d. sending a copy of the instrument for photo-reproduction. 
Unfortunately, the photocopies were not available until 
after lunch, about three hours later. 

Fourth, the "game plan" for the six work group sessions was 
somewhat complex to cover in detail with the facilitators and host 
recorders in the time available; and the latter, in turn, were con- 
cerned about their ability to cover it adequately during the first 
work group session. Therefore, the decision was made to explain only 
that part of the plan pertaining to a given session. As a result of 
that decision, many of the work group participants never developed a 
full and clear picture of where they were heading and how they were 
going to get there. 

Fifth, the trainers referred at least three times to the rigors 
of the conference schedules - rigors that were undeniable. Unfortunately, 
the extraordinary demands of the schedule combined with dubious commit- 
ment ta- the Delphi process to convince a few of the facilitators that 
their participation was just not worth the effort. Apparently, some 
of them discussed the combination with mounting, annoyance during the 
lunch break, because they returned to the training session in a 
mutinous frame. Again, the trainers reacted appropriately: they 
defused the bomb with an offer to allow facilitators and recorders to 
withdraw then and there, without prejudice. One facilitator did 
eventually withdraw, although perhaps for different reasons. 
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Sixth, some of the facilitators were less than competent (as 
small group leaders) and under conrunitted, (according to many observa- 
tions recorded in participant evaluations). Others were quite 
effective and led their groups to the production of significant re- 
sults. 



group sessions also generated unexpected reactions. It developed 
that sonB in each group had never seen the Delphi instrument, much 
less filled it out. A consensus set in, in some groups, that "these 
results are interesting, but they are not our results." The process 
was regarded by many as an imposition, not of their own making, accept- 
able only under protest. Some groups abandoned the process and went 
their own way. Some members of these groups later regretted their 
decision at the fifth and last work group session because they had 
"bought out of" the overall conference process. 

Eigh*-h. complaints were registered in the work groups and 
participant evaluations to the effect that the listings of global and 
domestic problem were too long, too confusing, and sometime^ too 
interrelati^d tCf permit judicious ranking. Moreover, the method of 



ranking in urder of importance from 15 to 1 created problems. 
Many participants in different work groups ranked them the first time 
from 1 to 15 - rather than in reverse order - even though the in- 
structions were unequivocally clear - simply because that was their 
conception ot the "natural order of things." 

Then, having conscientiously made the rankings, members of some 
groups were upset to learn at the second session that the forms 
would not be used again; that is, they were not intended as a basis 




Seventh, the presentation of Delphi results at the first work 



t 
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for ongoing work group action. Incredibly, a government official 
from the National Institute of Education in the group opined that 
the completed and consolidated rankings would be used for making 
policy and taking action by the bureaucracy in Washington. That 
set teeth on edge, because group members felt they had not had time 
to review and address the issues presented with sufficient thought 
and thoroughness. 

How Could the Delphi Have Been Salvaged? 

Under the circumstances, what could have been done at Kansas 
City to minimize the traumatic effects of the Delphi process? The con 
ference coordinators did the best they could in the^ situation in 
which they found themselves. The only action that could have 
"saved" the morning training session for facilitators and recorders 
when the question arose, "Whst's a Delphi?", would have been the pro- 
duction of sufficient copies of the instrumeht to supply everyone, 
folloir;ed by thorough review of the instrument by those who hsd not 
seen it, discussion of the results of complsted surveys, and a 
8tsp-by-*8tep discussion of ths way in which ths instrumsnt wss bsing 
ussd. Ideally, svsry psrson in the room would have voiced his under- 
standing and accsptancsC. 6r rejection) before the discussion was 
conciudsd. 

It is significant that ths trainsrs wsrs opersting undsr time 
constraints not of thsir own making. They had rsqusstsd at Isast a 
day and a half for ths sessions and had bean gfvsn about six hours. 
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Similarly, the objections raised at the first work group seasion^ should 
have been dealt with immediately at a plenary sessioni in the spirit of; 
"We've got a common problem here. This is what we ytete trying to do. 
These are some of the objections you raised. We see yodf point. 
Let's talk it out until we've agreed how we want to proceed from here." 
Such reaction waa impoaaiblOi becauae of a achedule that waa extra^ 
ordinarily full, tightly scheduled, and inflexible. 

Some Recommendations for Further Uae of the Delphi 

Whatf then I of the Delphi? It is probably worth another try, with 
different ground rulea, and with a different name for thia atill 
unfamiliar process e.g., conference coneenaua/aurvey form. Here are 
several other suggeationa: 

1. Keep the consensus survey instrument short and simple , 
addressing only one or two key issues, ao that it can be 
filled out adequately in perhape twenty minuteai with^an . > 
option for as much additional input as the respondent may 
care to contribute. 

2. Explain in detail the objectives of the conference i and the 
specific way in which the survey returns will be used be* 

fore and during the conference to advance conference objectives 
3« Be sure that every invitee receives the survey and returns it 

either completed orioptionallyy reviewed but not completedi 

as part of "the price of admission." 
4. Condense the responees on each question to no more than 

ten key concepts which can be readily comprehended « These 
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responses must become essential building blocks in the 
process of reaching conference objectives; and every 
participant must perceive that they are essential. 
At the first conference plena*/ session, answer fully the 
question, "Why are we here?" Discuss the purpose of the 
conference, its objectives, the anticipated products, the 
longer-term benefits they can expect for themselves, their 
organizations, and their communities; and the process by 
which the planners propose to achieve the objectives and 
generate the intended product, to include the contribution 
to be made by the Delphi process. 

Allow plenty of time for participant peaction - and pay 
attention to that reaction. If there is substantial 
dissent, modify the conference plan on the spot unt^ i 
consensus is achieved. A conference which has been designed 
to produce results will succeed only to the extent that 
participants are personally committed to objectives and outcomes. 
Spend the first small-group session in such discussion of 
conference objectives and plans as group members find necessary; 
and act to dispel any dissatisfactions that epell trouble. 
Again, there is no point in proceeding until all group mem- 
bers are on board. 

Spend the remaining time in the first session in self-introductions 
with particular reference to how each group member sees himself 
as relating to the conference. Give him a chance to deliver 
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the ''compulsory conmercial'' he brought to the conference. 
Otherwise, the time he chooses to deliver it may be confounding 
to all. Encourage fellow group members to -ask questions. 
The goal is to let every group member "size up" or "get 
a feeling" for every other group member. 
Introduce Delphi consensus survey results only as points of 
take-off. Let the group accept the list offered or come up 
with its own. Then let them refine the list as dictated by 
conference needs, through wide-open discussion until such 
consensus is reached. 

See that each use of Delphi consensus results clearly ties 
into, and contributes to, the attainment of conference 
objectives. 

Obviously, all the points made above should be incorporated 
into the training sessions for facilitators and recorders. 

1 
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VII. FURTHER ANALYSIS AND FOLLOWHIP ACTIVITIES . 
(Phase II) 

Phase II Ani^lysis Proposed 

Our proposal to the citizen education staff for this evaluation 
included a stage two plan for further analysis and follow up. 
In this activity we have proposed that the following tasks 
be undertaken: 

1. complete our statistical analysis of the data obtained 
during stage one e.g.^ factor analysis of the teaching/ 
learning environment. scale and regression analysis of 
results. 

2, complete our analysis of conference outputs such as the 
Delphi results and the work group reports in terms of 
basic conference objectives and external evaluation 
criteria. 

.3. Revise all conference evaluation foims for use in other 
USOE or privately sponsored conferences at the national, 
regional, state, or local levels. 

most importantly , we believe that a follow-up evaluation 
of some 400 conference participants, .leaders, and speakers 
is essential for the proper assessment of the outputs or 
effect of this conference. This would entail construction, 
distribution, and statistical/content analysis of all replies 
to a short (two page) questionnaire regarding a citizen 
education network and application of conference substance 
to one's own professional or work activity. 
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Other Follow Up Activities 

In addition to these proposals, it is also suggested that the 
results of this conference evaluation be more broadly disseminated 
as a model to all participants as well as to conference leaders and 
participants in other citizen education conferences under USOE 
sponsorship. We would also propose that any future conferences 
should have an independent evaluation built in from the planning 
stages to obviate the difficulties encountered with this process 
at Kansas City. Such involveirent would allow for clearer definition 
and statement of conference goals and processes from the start so 
that they could be more effectively achieved as well as evaluated. 
The independence of the evaluatora must be maintained, however, so 
that an honest audit of the activity can be t^nsuf't'd and bias pre- 
vented. There is no use, however, in repeating mistakes of the past 
if we know how to avoid them from our experience. 
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Form #1 
Firt A 

CCITFEREE/PARTICIPANT EVALUATION OF EDUCATION AND CITIZENSHIP 
CONFERENCES, SEMINARS, AND WORKSHOPS 



Directions ; 

This questionnaire gives you the opportunity to express your views 
about this meeting and the way It was conducted. We want to know 
about your background, your opinion of the meeting site, facilities, 
and schedule, what ^ou liked and disliked about the gathering, what 
yo" learned from this experience, and what you can do to Improve 
the current status of citizenship education now and in the future. 

This information will be used to Improve the planning and administration 
of future citizen-education meetings sponsored by the U. S. Office of 
Education. 

You are being supplied with four items: (1) A multiple-choice ques- 
tionnaire. Form #1, Part A; (2) One IBM answer card; (3) one electro- 
graphic pencil; (4) An open-ended questionnaire, Form #1, Part B. 
Questionnaire . Part A, with IBM answer card and electrographlc 
pencil ; 

On the answer card, under NAME, please print the name of your 
organization or institution and your own last name. 

Indicate the response (A to E) closest to your view by completely 
blackening both sides of the letter on the answer card for each 
question with the electrographic pencil . Should you wish to change 
a response to a question, simply erase completely your previous 
response and blacken the more appropriate space. ^ Do not indicate 
more than one response to a question and do not use ink or ball 
point pen to record your answers on the answer card. 

Begin your response by completing the background information requested 
on the answer card and Part B of Form #1, the open-ended questions. 
Please do not write on Part A of the questionnaire which will, be used 
for future meetings. 

Leave blank any question which you are unable to answer or which is 
not applicable to you* 

Questionnairet Part B , ylth pencil or (preferably) pen; 
Please print or write legibly, In as much detail as you wish. 
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Form #1 
Part A 



RESULTS (IN PERCENTAGES) OF PARTICIPANTS RESPONSES 
N = 182 RESPONSES OMITS > 10% ARE NOTED 



Section 1: Participant's background, views on educational innovators 
and conference application procedures. 



Omitted 

from 

analysis 



5, 



6. 



7. 



Omitted 
from 
analysis 



8. 



9. 



10, 



Which term most accurately describes the overall type of meeting 
which you are attending? 

_ ^ A, Voluntary organization workshop 0 B. State seminar 

_ 3 
95 



C. Regional conference 
National conference 



J; D. Exemplary workshops 



2. In which region of the country do you live? 

_25 A. Northeast 12 B. Southeast 48 C. Midwest 
6 D. Northwest 10 E. Southwest 

3. What is the approximate size and type of the area in which you work? 

34 A. Large city between 50,000 and 250,000 22 B- Small city 
under 50,000 40 C. Metropolitan area over 250,000 4 D. Rural 
under 2,500 population 1 

4. What Is your sex? 35 A. Female 65 B. Male 



What is your age? 

7_ A. 20-29 years 

26 D. 50-59 years 



26 B. 30-39 years 35 
7 E. Over 60 years 



C. 40-49 years 



How would you primarily classify the organization in which you work? 
Clark one answer either //6 or //7) 

66 . A. Educational 5_ B. Religious 17 C> Governmental 

7 D. Business and industrial 1^ E. Voluntary community 

organization or foundation 



(Continuation of //6) 
48 A. Home 16 B. 
(X E. Health 



Labor 4^ Agricultural 28 D. Media OMIT N 



How large is the market or target population of 'consumers for 
which you supply your services? 

10 A. Regional (several states) 5_ B* International 

23 C, Statewide 26 D. Nationwide 36 E« Local 

For that part of your work which is educational in nature, 
what would you primarily classify yourself as doing? 

53 A. Administration 21 B, Teaching 5^ G. Research 

20 D. Other 

How many years have you been involved in education-related work? 

g A. Fewer than 5 years 17 B. 6 to 10 years 20 C. 11-15 years 
12 D. 16-20 years 42 e. Over 20 years 
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11. How many people are directly responsible to you in work, i.e. 
work for you, have to answer to you, were hired by you, etc. 

A. Fewer than 10 persons 23 b. Ten to 100 person 

15, C. From 100 to 1,000 persons 3_ D. More than 1,000 persons 

13 E. None 

12. Have you been primarily responsible in the past few years for 
initiating any new plans, programs, studies, etc. in citizen 
education? 

69 A. Yes 30 B. No 

13. Are you personally familiar with any new citizenship education 
programs, plans, studies etc. which are underway in the U. S. 
today? 

70 A. Yes 29 b.'No 

14. Which of the following is most responsible for actual change or 
real innovation in citizen education in the U. S. today? OMIT N = 17?q 

A. Federal agencies such as USOE, NSF, etc. 

^ B. Publishing firms 15 C. National professional organizations 
^7 D. Local educational authorities 13 e. State departments 
of education 

15. Which of the following is most responsible for actual educational ' 
change or real innovation in citizen education at the local level? 

A. School Superintendents 27 e. School principals and OMIT N = 12% 
administrators H C. Department chairpersons and supervisors 
8 D. School hoards 40 E. Teachers 

16. Which of the following is moet responsible for actual educational 
change or real innovation in citizen education at the college or 
university level? 

10 A. National professional organizations 41 B« Professors 

and teachers 20 c. Individual departments and disciplines OMIT N = 19SS 

4 D. Administrators such as department head, deans, etc. 

15 E. Instructional deVelopment/improvement offices 

17. Which of the following is most responsible for actual educational 
change or real innovation for citizen education at the state level? 

^6 A. Chief state school officers or superintendents of 

of public instruction OMIT N = 23% 

29 B. State supervisors of history, social studies, or citizen 
education 19 c. Influential colleges or universities 
in the state 13 D. State boards of education 
4 E. State textbook selection committees 

18. Which of the following types of organizations are most influential 
for effecting real educational change in the U. S. today? OMIT N a ll?o' 

22 A. Private, non profit, or foundations 49 B. Educational 

1 C. Regligious 6 D. Business^ labor or agriculture 
22 E. Governmental 

19. Which of the following types of organizations Is least influential 
for effecting real educational change or innovation in citizen 
education in the (J* S. today? 
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A, Private, non-profit, or foundations ^ B- Educational 

C. Religious 37 D. Business, labor or agriculture 
7_ £• Governmental 

Fow significant would you say your role is as a"* key agent in 
citizen educational change at the local, state, or national 
level? 

11 A. Cannot estimate their significance 8_ B. Insignificant 

26 C. Very significant 37 D, Moderately significant 
18 E, Somewhat significant 

How significant would you say most of the other participants 
(not staff, speakers, or leaders) are as key agents in citizen 
educational change at the local, state or national level? 
31 A. Cannot estimate their significance 2 B, Insignificant 

17 C. Very significant 37 D. Moderately significant 

13 E. Somewhat significant 

How much previous contact or involvement have you had with the 
citizen education field? 

6_ A. None JL6_ B. Very little 25 C, Some 30 D. Quite a bit 

22 E. Very much 

How much previous contact have you had with the sponsoring 
organization for this meeting? 

23 A. None 23 B. Very little 31 C. Some 11 D. Quite a bit 

22 E, Very much 

Which of the following reasons best explains why you are attending 
this meeting? 

1^ A. It is part of my job 4^ B. It is purely voluntary on 

my part 42 C. I am interested in citizen education 

D* I was invited to attend 3 E. None of the above (please 
explain in open-ended comments for Part B of this questionnaire) 

How did you hear about the conference? 

A. Invitation for the sponsoring organization 15 B, Solicitation 
from another person or agency involved in the program 15 C. Referral 
of information from another person who was invited 15 D. By another 
method (please explain in open-ended comments for Part B of this 
questionnaire) 

To what socio-'economlc class would you say you belong? 

_i A. Upper 74 B. Upper Middle 18 C. Lower Middle J D. Lower 

What is your religious affiliation? 
39 A. Protestant ^5 B. Catholic 10 C. Jewish 13 D. Other 

What is your ethnic background? 

L- A. Black/Negro 3 B. Hispanic 1^ C. Asian/Pacific Islander 

1_ D. American Indian/Alaskan native 88 E. Caucasian/white 
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29. In terms of your overall political stance or attitudes, how 
would you classify yourself? 

.1 A. Extremely conservative 11 B. Conservative 

C. Liberal 35 D. Middle of the road 6 E. Extremely liberal 

30. In your opinion is a nationwide reform in citizen education 
necessary? 

79 A. Yes 6 B. No 16 C. Do not know 



31. Of the following, which .study area do you believe is most crucial 
for the future success of citizen education in the U. S. 

34 A. Political participation 17 B. Global perspective 

9 C. Economics 15 D. Ethnic and multi-cultural 
6 E. Business, labor, industry related 

32. Of the following, which study area do you believe is most crucial 
for the future success of citizen education in the U. S.? 

10 A. Historical (including U. S. Europe, and the world) 
B. Political (incljides civics, American government, 
problems of democracy, international relations) 
29 C. Social Studies (includes interdisciplinary social 
science courses) 

I D» Geographical _9 E. Other (psychology, sociology, etc.) 

33. Of the following, which study area do you believe is most crucial 
for the future success of citizen education in the U. S.? 

15 A. Law-related/criminal justice 50 B. Valuative, ethical, 
and moral 16 Family-related 15 D. Social science/ 
behavioral studies 4_ E. Other (please explain in Part B 

34. Of the following, which is the most important reason why you are 
attending this meeting? 

26 A. To meet and talk with others interested in citizen education 

II B. To obtain factual information about citizen education 
12 C. To help with my professional growth 

18 D« To learn about new approaches to teaching and learning 

in citizen education 
34 E. To engage in give-and-take experiences with experts in 

citizen education 
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Section H: Participant's evaluation of meeting site, facilities, 
and general arrangements 



NOTE; If you mark "No" or "Other" for any of questions 

35-47, please explain in Part B, 

35, Was the site for this meeting convenient for you? 

90 A. Yes 9 b. No _1 C, Other 

36, Were you satisfied with the facilites and/or accommodations for 
the meeting? 

.JL'^-Yes B, No 1 ^ C. Other 

37. Could the meeting site, facilities, or general arrangements 
have been signif i&antly improved or continuing deficiencies 
(if any) corrected? 

^6 A. Yes 50 B, No ^ C, Other 

38. Were the meal times and restaurant facilities in the area adequate? 

B5 A. Yea Lb. No 5_ C, Other , 

39. Were the dates of the meeting convenient? 

91 A, Yes 9 B, No 0 C, Other 

40, Were the coffee/coke/mealtime breaks adequate? 

7 A, Too long 69 B, Adequate 22 c. Too short 

2 D, Other 
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41. Was there sufficient time for you to establish Informal contacts 
at this meeting? 

— ZLa. Y*is 65 B . Mo _£__c. Other 

^JlrtllVr, allowed for you to enjoy rest, reading, 

recreation and social occasions? 

—6 — A* ■'fes _22 B. No 1 C . Other 

43. Was the system for general communication at the meeting adequate? 
_66-_A. Yes 32 B . No 3 C . Other 

th^mee^lng'^^^^**^ "^'^ organization end scheduling of 

_4Q_A. Yes 54 B . No _6_C. Other 

45. Did you find this meeting as a whole to be of value to you? 
_2L_A' Yes 6b. No 8 c . Other 

46. Approximately what percentage of the regular scheduled activities 
did you attend during this meeting? 

^^I^ meeting rooms conducive to effective communication? 
_88_A' Yes _J_B. No 4 C . Other 

Section III: Participant's Evaluktlon of the Program for this Meeting 

48. During group-partlclpatlon sessions you attended, about how often 
did you participate In the discussions? 

-TT-J* 2"'"* — «8 a" no" others 

_£X__D. More frequently than most others 

P^"" ''^^ relevancy of each of the functions 

listed below according to the following key: 

■n* Above average ^C. Average 



JD. Below average E. Poor 



49. Registration arrangements 

_S3_A. 23 B . 19 C . 1 D . 4 E . 

50. No-host reception 

_-22_A. 2B B. 35 C . 3 D . 2 E . 

51. Presentation #1: Organization of the Conference 
— 16-A. B. 28 C . 8 D . 12 E . 

52. Presentation #2: What are the Crucial Problems Pacing American 
Citizens and our Society During the Next Quarter Centurs' (1976-2001)? 
-i£L_A. ?? B. 29 C . n D . B E . 
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53. Presentation #3: An Historical Perspective of Citizen Education 

^1 A . 31 B . 23 C. _J p. _2 E. 

54. Presentation /^A: Relationships Between the Crucial Problems and 
Various Sectors In American Society 

16 A . 40 B . 29 C . _ig D. __5 E. 

55. Presentation #5: What are the Current Problems and Deficiences of 
Citizen Education? 

14 A . 27 B . 36 C . 17 D . 6 E . 



QUESTIONS 
56 - 62 
Omitted 
from 57 
Analysis 



58 
59 
60 



56. Presentation H: How can Citizen Education Help Resolve Crucial 



61. 



Problems? 
25 A. 29 B. 37 C. 



_i_E. 



OMIT N = 41» 



Presentation ifl: A New Citizen Education Program: Suggestions and 
Recommendations . 

31 A . 38 B . 24 C . 3 D . 4 E . OMIT N = 445S 

Presentation #8: A Personal Report of What Shaped Me as a Citizen 
21 A . 27 B. 34 c. 4 p . 14 E . 
OMIT N = 69K 

Presentation #9: Results of Delphi Survey 



A. 



9 B. 



32 C. 



14 D. 



ja_E. 



OMIT N = 625!; 



Fresentacion if 10: What Should Be the Relationship of the Individual 
Citizen to the Larger Society? 
25 A . 25 B . 39 C . 2 D . 9 E . 



Presentation #11: Work Group Reports 
12 A. 22 B. 38 C. 14 D. 



14 E. 



62 i Presentation #12: Panel Discussions and Group Reactions 
19 A . 34 B . 37 C . 4 D . 4 E . 



63. The thirteen presentations as a whole 
8 A . 50 B . 34 C . 7 D . 



64. The seven work group discussions as a whole 

13"'A . 35 B . 28 C . 16 D . 8 E . 

65. The four special activities as a whole 

18 A . J9 B. 33 C . 9 D . 2 .E . 



OMIT N = 765S 

OMIT N = 62% 
OMTI N = 63SS; 
OMIT N = 30% 
OMIT N = 23S!; 
OMIT N = 23SS; 



Section IV: Participant's Eval\iation of Other "Inputs" for this Meeting 

Using the same rating scale ( A Excellent B Above average 

P Average D Below average jE Poor), please rate the effectiveness 

of the following supplementety activities or "inputs" for this meeting. 

66. The letter of invitation and related information about the meeting 

-ifl-A- -22-B. .JULS, Ifi D. JL_E'. QMiT N = 12SS; 
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67. Definition of purposes/objectives of the neeting 

7 A , 20 B . 31 c . 22 p . 20 e . 

68. Use of the Delphi survey Instrument before the meeting 

« J-A. 15 B . 26 C. 20 p. 36 E. OMIT N = 15? 



69. VaB of the Delphi survey Instrument during the meeting 

3 A . 13 B . 17 C . 21 P . 47 E . 

70. Consensus developed from the Pelphl survey Instrument by the end of 
the meeting 

^ A . 14 B . 23 c . 20 p . 39 e . OMIT N = 23% 

71. The displays of currlculun, teaching-learning, nev social studies, 
and citizen education oaterlala available at the meeting 

12 A . 33 B . 43 c . 10 D . _2 ^e. 

Section V: Participant's Evaluation of the Impact of This Meeting 

Using the same rating scale ( A. Eaccellent B. Above average 

C. Average P. Below average E. Poor), please rate the effectiveness 

of the conference In addressing problems of citizen education In each of the 
categories listed below. 

72. Home and community 

7 A . 30 B . 35 c . 23 p . 5 e . OMIT N = 16515 

73. School 

18 A . 51 B . 23 C . 6 p . 2 E . OMIT N = 15515 

74. Church 

1 A . 11 B . 23 C . 40 P . 25 E. OMIT N = 23515 

75. Business and Industry 

1 A . 10 B . 29 C . 31 P . 29 E . OMIT N = 2155 

76. Labor 

2 A . 5 B . 22 C . 39 P . 32 E . OMIT N = 225S 

77. Agriculture 

1 A . 4 B . 20 C . 32 P . 43 E . OMIT N = 255S 

78. Local government 

2 A . 16 B . 26 C . 35 P . 21 E . OMIT N = 23S5 

79. State government 

2 A. _11B. 31 C . 33 D . 18 E . OMIT N « 2155 

80. Federal (national) govemmant 

9 A . 26B . 32 C . 21 P. 12 E. OMIT N = 205S 
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* 81. Voluntary organizations 

^ A , 13B . 34 C . 31 D . 18 E . OMIT N = 11% 

82. The mass media 

5 A . 25B . 34 C , 22 D , 13 E . QMIT N m 11% 

83. The crucial problems of contemporary and future American society 

10 A. 31 B . 33 C. 17 D. 9 E. qmit N = 11% 

84. Producing a necessaryi practical^ and desirable plan for the reformulation 
and regeneration of citizen education for the present and the future 

J A. 20 B. _J1_C. 27 P> _2£L.E. qmit N = 19?i 

Section VI: Participant's Evaluation of the Teachlng<*Leamlng Environment 
for This Meeting 

In answering the questions below, use the following key: A (Highest rating) 
through E (Lowest rating) 

85 • To what <»tent did this meeting duplicate others which you have attended? 
Omitted ^4 A. 21 B. 27 C. _L£_P- _Z2_E- gj^jj ^ ^ ;L3S5 

froin 

Analysis 86. To what extent did you as a participant assume responsibility for making 
this meeting as productive as possible? 
30 A . 47 B , 18 C . J J). J ^E. 

87. To what extent did the conference leaders appear to know the subject matter 
of citizen education? 

25 A . 37 B > 28 C . 6 D . 4 E . 

88. To iriiat extent did this meeting help to stimulate your Interest in learning 
about citizen education? 

28 A . 40 B . 23 C . s D . L E . 

89. To what extent did this meeting provide an atmosphere which was conducive to 
learning about citizen education? 

21 A . 40 B . 24 C . ^2 D. _4 ^E. 

90. How willing were the conference leaders to adjust the agenda of the meeting 
to adapt to participant-expressed interests and needs? 

22 A . 27 B . 21 c . 20 p , 10 E . 

4 

91. How veil did the meeting progress from a logical or meaningful beginning 
to a coherent conclusion? 

3 A . 21 B . 29 c . 26 D . 18 E . 

92. Did the conference leaders use pertinent examples to Illustrate their 
points? 

8 A. 37 ^B. 40 c. 9 D. 6 E. 
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93. Did the conf«v«nc« leaders talk or present material at a speed conducive 
to understanding? 

22 A . ^2 B . 27 c . 6 p . 3 e . 

94. Were the presentations coherent and organized? 

20 A . 43 B . 31 C . _4 p. _2 E. 

95. How well did the conference leaders explain difficult Ideas? 
_Ii«A. 39 B . 33 C . 10 D . _5 E. 

96. How effectively did grom» discussions promote conference objectives? 
_11_A. 29 B . 33 c . 1/ p . _J£jE. 

97. How much participant Involvement was there^ In^group discussions? 

98. How capably did the conference leaders direct group discussions? 

23 A. 31 B . 27 C . 14 D . 5 E . 

99. How well did the conference leaders answer questions from participants' 

IB A . 35 B . 30 C . 12 D . 5 E . 

100. How weU did the host recorders summarize the contributions of Individual 
group members? 

35 B. 21 C . _11 p. _2 E. OMIT N = 15% 

101. How satisfactory was the balance between theory and application In this 
meeting? 

5 A. 23 B . 40 C . 25 D . __6 E. 

102. How weU did the printed/duplicated material help to clarify the content 
objectives of the meeting? 

2_A. 28 B . JZ C. 20 D . jE. OMIT N = 12S!; 

103. How often did the staff and others talk with participants before and 
after formal sessions of the meeting? 

__ifLA. 34 B . 33 C . 14 D . _5 E. OMIT N = 12% 

104. How helpful were informal contacts with the conference leaders? 
__ilA. 29 B . 33 c . _12 p. 8 g. 

OMIT N = na; 

105. To what extent were the conference leaders fair and Impartial in dealina 
with participants? * 

^1 A . 34 B . 19 C . 2 D . 3 E . 

106. How would you rate the conference leaders' sense of humor? 

33 A . 37 B . 21 C . 6J). _3 E. 

107. How sensitive were the conference leaders to the feelings of participants? 

31 A . 37 B . 18 C . 8 D . _6 E. 

108. How tolerant were the conference leaders to all points of view? 
_iLA. 31 B . 19 C. 6 D. 6 E. 
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APPENDIX II 



FORM n 
Part B 



CONFEIIEE/PARTICIPANT OPEN-ENDED QUESTIONNAIRE 

^IIl^L^Jr" °P^^°n^l but it will help to evaluate the Conference 

^^^^^ complete it if you have the time or send it 
with the attached envelope.) 



Directions: 



This section of the questionnaire provides you with an 
opportunity to explain or qualify some of your choices in 
Part A as well as to express your general impressions of 
the conference. Please complete the following information 
o^^ore answering the questions below. 



ZlslilZ!^?! completing Part A of this 
: minutes. 



2b. PRINT NAME: (optional) 



3b. PRINT HOME MAILING ADDRESS: (optional) 



4b. PRINT OFFICIAL POSITION AND 
MAILING ADDRESS :(optional2_ 



^Street 
JTown/City 



__State & Zip Code 



JTelephone Number & 
Area Code 



JPosition/Title 



_Firm/School/ 
Organization Name 



_Street 
_City/Town 



_State & Zip Code 



JTelephone Number & 
Area Code 



5b* What is your function at the conference (Participant, Staff Member. 

Resource Person, Presenter, Reporter, Discussion/Work Group Leader! etc.) 
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6b, What sector do you represent? (Check one): Home ; Education 



Religio n ; Business and industry ; Labor ; Government 

Voluntary community organization ; Medi a ; Health ; 

Agriculture ; Foundatio n ; Other (Please specify) 



7b. Tf vou have anything to add In the way of explanation or clarification 

for vour response(s) in Part A, please do so here: (continue on reverse) 



8b. IHiat were the major objectives of this meeting as vou perceived them's 



91j^ What were the strongest points of this meeting? 



10b. What were the weakest points of this meeting*! 



lib. How could meetings such as this be Improved in the future? 



EKLC 
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12b, What were the key questions you had In mind before you came to this meeting? 



13b, What were the key questions you had in mind during this meeting? 



14b. Which of these key questions were answered in whole or in part by the 
end of this meeting? 



15b • Which of these key questions were not answered in whole or in part by 
the end of this meeting?^ 



16b. Would you be willing to participate in an on-going effort in the near 
future for citizen education? Yes No 



_Do Not Know (Explain) : 
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17b, What techniijues do you intend to use to inform others about the 

citizen education effort (e.g., program planning, media use, citi 
zen organizations, textbook selection)? 



18b, What is your personal conception of an ideal core curriculum for 
enhancing citizen education at the educational level with which 
you are most familiar? 



In this portion of Part B, please detail any comments you wish to make 
about each of the following segments of this meeting: 

19b- The twelve major conference themes identified in the principal presentations 



20b- The appropriateness of the eight major social sectors (home, school, media, 
etc.) identified as impacting upon the crucial problem areas 
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21b, The twelve crucial problem areas of American society (energy, unemploy- 
ment, environment, etc.) identified for special consideration at this 
meeting . 



22b. The four special activity groups 



23b. The seven work group presentations 



•24b, The use of the Delphi instruments 



2Sb. Other summary comments 



26b. Approximately how many minutes has it taken you to complete Part B of 
this questionnaire? minutes. 
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27b. Could this evaluation procedure be Improved? (Please explain) 



Thank you very much for your time, cooperation, and valuable assistance In 
making this and future conferences a worthwhile experience. 
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FORM #3 

SPECIAL ACTIVITY LEADER'S/WORK GROUP FACILITATOR'S /HOST RECORDER'S 
EVALUATION OF ASSIGNED ACTIVITY /EVENT 

Which of the following sectors do you represent? Education 

Religion Business and industry Labor Government" 

Voluntary connnunity organization Media Health 

Agriculture Foundation Other: 



To continue your response to any question, use the reverse side. 
Please enter the number of the question being continued. 



1. Name (optional) 



2. Did you serve as a (choose one) Special Activity Coordinator 

Work Group Leader , Reporter ^, or 

In another capacity (please specify) : 



3. What were the major objectives of the group (s) with which you 
worked in a leadership/reportorial capacity? 



A. How did these objectives relate to the general objectives of the 
• Conference? 



5. Which of these objectives were achieved? (Please cite any tangible 
evidences of achievement.) 
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FOBM #3 (CONT.) 



6. Which of these objectives were not achieved? What are your opinions 
as to why not? 



. How could this group activity be improved in the future? 



NOTE: Please return this completed form to a Citizen Education staff 
member before the end of the meeting. 

Thank you for your cooperation and contribution to Citizen 
Education. 
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RESOURCE PERSON'S/PRESENTER'S EVALUATION OF CITIZEN EDUCATION MEETING 

Which of the following sectors do you represent? Education 

Religion Business and industry Labor Government 

Voluntary community organization Media Health 

Agriculture Foundation Other: ^ 



To continue your response to any question, use the reverse side. 
Please enter the number of the question being continued. 



1. Name (optional) 



2. Title/position/official capacity at this meeting(optional) 



3. How long did you attend this meeting?^ 

4. What were the major objectives of the meeting as you perceived them? 



5, How did your professional effort relate to these objectives? 



6. What activities/events did you observe or participate in while at 
this meeting?^ 



7. What are you. general impressions about this meeting (site, staff, 
participants, program, resources, etc.)? 



NOTE: Please return this completed form to a Citizen Education staff 
member before you leave the meeting site. 

Thank you for your cooperation and contribution to Citizen Education. 

I M J. 



APPENDIX V 

FORM #2 

PARTICIPANT OBSERVEBl'S EVALUATION OF CITIZEN EDUCATION MEETING 
ACTIVITY/ EVENT 

Which of the following sectors do you represent? Education 

Religion • Business and industry Labor Government 

Voluntary community organization Media Health 

Agriculture Foundation Other: 

To continue your response to any question, use the reverse side. 
Please note the number of the question being continued. 

1. Date of observation: 

2. Times of observation: From: To: 

3. Type of event/activity observed: 

4. Name (optional): 

5. Title/Position/Official Capacity (optional) 

6. What were the major objectives of the activity /event which you 
observed? 



7. How did the activity/ event contribute to, or coincide with, the 
general objectives for the meeting? 



8. What were the strengths of the event /activity in terms of these 
objectives? 
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What were the weaknesses of the event/activity In terms of these 
obj ectlves? 



To what extent did the leader/facilitator help the group" to 
achieve its objectives? 



How could the event/activity be Improved in the fu'ure? 



Other comments, personal observations. 



NOTE: Please return this completed form to a Citizen Education 
staff member before the end of the meeting. 

Thank you for your contribution to Citizen Education. 
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PAKTICIPANT RESPONSES - WILLINGNESS TO PARTICIPATE IN 
FimjRE CITIZEN EDUCATION ACTIVITIES 

Question 16b. asked: "IVould you be willing to participate in an 
on-going effort in the near future for citizen education?" 
Respondents entered explanatory comments covering the "Yes" 
cat^igory as well as "No" and "Do Not Know." All of these 
cocaents are recorded belav. 

The double-letter code in parentheses at the end of each comment 
identifies the questionnaire from which the comment is abstracted. 
All questionnaires are available for inspection in the office of 
the citizen Education Staff, U.S. Office of Education. 

Yes 

It is a great topic. (AE) 

Iiocnlly. (AG) 

If time permits. (AP) 

Would want to know better the goals of the effort. However, the area 

is vital. (AU) 
Very interested. Good start. (AY) 

Absolutely ^ and give it ny all. (BO) , 

I have bean working on it professionally for 15 years and will continue 

to d:> so in spite of meetings like this. (BP) 
Definitely -* YES. (BQ) 
As time permits. (BR) 
Decidedly I (CB) 

There are will know viewpoint from parent. (CD) 

Z think that our institution would be anxious to participate in efforts 
to in^rove curriculum and to derive new concepts for application at 
the university level. (CF) 

I am constantly working in Citizenship Ed. and have gained much from 

thi5 conference anJ want very much to be involved in any on-going 

effortin (CK) 

Because it is so inqportant. (CD 

It is my hope that a higher priority can be placed on this area of 

education by all educational agencies and communities. I would like 

to be a part of the movement. (CM) 
Delighted - this session has generated a deep interest in citizen 

education. Understanding the goal of the conference, seeing the 

beauty of diversified input. (CN) 
It is a critical area of concern. (CO) 
Enthusiastically! (CU) 

Regional conference follow up in the states of Region III 

N.D. S.D. Utah Colo. Wyo. and Mont. (CZ) 
If I clearly understand my ftinction. (DA) 

Has been one of my major professional concerns for years and see no 

nffid to change now. (DD) 
The Citizenship Development Program at the Mershon Center would be 

willing to help in the design and execution of future conferences 

if that would seem useful. (DF) 
The conference was discouraging but commitment runs deeper. (EG) 
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Question I6b. (continued) 
No 

Not if It purports to follow on from this conference. (BT) 
Do Not Know 

Much depends on the demand on roy time. (AI) ^ 
1 will have to have some time to reflect on the matter. (AL) 
Time requirements vs. lay available time. (AS) . ^ ^ 

... .My competence to speak in the public school setting since I 

come from non-public school setting. (BB) 
It depends on the time and place. (BG) * 
Perhaps. Time could be a constraint. Having enough time to 

participate . (BH) , j ^.v 

Willing yes - but only if I felt I could be of real service t;o the 
occasion as planned instead of being a pawn in a mammoth checkers 

1 flu* that some grass roots organizing experience would be useful in 
devvloning ftirther conferences. That could help sector participation, 
methods of getting t;o the central issue and getting it discussed, etc. 
(CI) 

Limitations of time may be a strong factor. (CS) 

Will be pleased to review each situation as it comas up. (CT) 
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LISTING OF PARTICIPANT RESPONSES - STRONGEST POIIyTS 

OF THE MEETING 

9b. What were the strongest points of this meeting? 

AA3 Dialogue with participants 
AB3 Opportunity for discussions 

Outstanding speakers 
ACS Hearing what others were doing 

Special activities 
ADS Many viewpoints expressed 
AE5 A good dialogue with laxge ovearview 

AFS Presentations by main speakers and activity session presenters 
AGS The sharing of ideas and activities already working toward 

the conference goal 
APIS The brzdlnstorming discussions in the work sessions 

Dr. Coles address 
Alio The speakers at the general sessions were outstanding. 
AJIO People participating 
AKIO The main speakers 
AL12 The topics chosen 

The pre-xneeting questionnaire 
AM12 Good speakers 

Good organization 
AN14 Some bf the major speakers 

Some of the presenters at "Special Activities'* 

The '*mix'' of >eople represented 

Availability of speeches 
A014 Work sessions, small groups 

Quality of presenters and participants 
AP14 Good speakers 

Organized and well developed group discussions 
AQ14 Complex area that needs to be worked on by all sectors of 

society 

AR14 '^Special Activity*^ presentations and discussions 

Contact with other educators and authors in this field 
AS14 Veuriety and scope of expertise aveillable 
AT14 special Activity Sessions 

Opportunity to meet others interested in this problem 

Obvious commitment 6f many to the major task 
AU14 Highly planned atten^t to get all paorticipants to react on an 

equal basis 
AVIS Discussion 
AH15 Good speakers 

Good group leaders 

Lota of work in 3 1/2 days 
AX16 General speakers - motivation and Inf onnatlon 

Varied type of program throughout day 
AY16 Breadth 
AZie People I met 

Getting the ••ball rolling" 
BA16 Diverse grovrps 

Hide variety of opinions 

Corridor talk 

O-..^ :V.. . ,,,:1:39 -.. , 
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BB17 Good input 

Good discussion 

Good activity groups 

Good ••eoqperts" available 
BC17 Several of the speakers were outstanding. 

The sessions on ethics education were exceptional. 
BD17 Challenging thoughts 
BE17 The addresses 

The interaction with people across the country 
BF17 The speakers 

^The special activity (A) 
BG17 Rap sessions 

Small groi5> presentations 

Broad representation 
BH17 Special Activities on Ethics , 4«4.^^o4. Iaw^ 

BI17 Meeting people acUve in my specific area of interest - law- 
related education \a 
BJ17 Our group leaders ability to dial w/ a poorly planned and 

devised meeting 
BK17 Group discussions 
Speeches 

BL The fact that the meeting was called 

Opportunity to meet with people with diverse viewpoints and 

experiences relating to citizenship education 
BH Jesse Jackson, Badi Poster, Rob»t Coles, Freeman Butts (breakfast 

Tuesday morning) 

TO LSd°SrMlected attendance and how they got to business of 
■ conference 

Learned so much! 

Well programed 
BP Special, activities 
BQ Topic " Citizenship Education 

BR General Session presentations 

opportunities for exchange of ideas in the work sessions 

Special activity groups 
BS Potentially - the work groups 

A few speakers and presenters 
BT Certain presentations, eg, Butts 
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CA The interaction of the va^'ious sectors of society was extremely 

istportant 

CB The speakers (except Abby and Buckley) , particularly Secretary 

Mathews and Rev. Jesse Jackson 
CC The truly excellent speakers 

The exdiemge between the participants representing so broad a 

spectrum 

CD I don't have strong or weak points at this time, but there are 

some 

CE Parti cipsmts 

CP Several. lect\irers-''*Coles ^ Jackson, Mehlinger 

Seme very interesting and talented people that I met 
C6 The education of our children 

Getting the community and parents involved 
CH The mix of people 

Some of the general session speakers 

Full scheduling of time 
CI The specied groups were very info3naative/ especially for one 

not in education 

Rev* Jesse Jackson 
CJ The work groups. We were able to relate our feelings; plus 

we had a good leader George Lowe w/ the U.S. Office of Ed« 
CK Special Activity sessions 

"^Some" of the speakers 

Interaction with others 

Renewed committment and inspiration 

The materials shared 
CL Meeting new people 

Sharing Ideas , 
CM Special interest meetings 

CN Input from diversified sectors 

Interaction within small group when people began to trtist each 

other and really shared expertise 
CO Critical Issue topic (Citizen Education) 

Special Speakers 

Discussions groups 

Interaction with others 
CP The spread of participants from around the nation 

The major speakers 

The small groi^ organization^ both special euid Work groxxps 
The tight schedule whldi forced people to stay with the task 
CQ Finding niyself not alone In thinking citizenship Is of a highest 
priority 

Sharing concerns and successes 

Some excellent speakers who really laid it on the line 



ERIC 
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9b. 



CR The various gro\:qps represented 

CS General Sessions - speeches 

Work Groups disciissions 
CT Talks 

CO Broad basis for participation outstanding approach at this 

point 

Sincere desire by HEW officials to study the problem and 

listen to suggestions from conference participants 
C7 Participants M! Their willingness and Interest in working 

towards Improved perceptions/attitudes about C*E. 

Special Activity Groups well -prepared and presented 

Seme speakers Coles and Foster and Scriven 
CW Interactions with other participants 

Speakers 

Interest groups 
CX Concentrated attention (tight schedule) 

to a variety of approaches to citizen education i 

with some topflight addresses 

and good discussions 
or Excellent speakers 

Hy workshop was very good ^ Faclllltator excellent 
CZ Good coverage of the topic 

DA K ^ny of the speakers at gener£U. sessions were fine 

Aucention to presentations of specif io prograzn3 in small groups; 
e#g# Fred Newmann's project 

Gillespie at al "Comparing Political Experiences** 
DB Main speakers 

Group discussions 
DC Excellent array of speakers 

Special Interest groiip presentations 
DD Well organized presentation of the need for action 

Presentation and acceptance of diversity of opinion 

Emphasis and recognition that It la broader than school 

problem 

Dissemination of information on current programs 
DE St^rficlal Identification of problems on citizen education 

Initial confrontation of problems by citizens 

Future publicity can realistically claim 14 hour work«-days« 
la? The meeting brought together people from many sectors of society 

not just the universities and public schools. 

In addition, by the very fact of having taken place/ the 
meeting called attention to the need to 'revitalize citizen 

education 
DG The main speakers 

Work group sessions 
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Awareness developed between various sectors of society 
Brainstoiming and exdiange of ideas during work sessions 
(may not have been true in other work groups) 

Special activity groups - allowed most opportunity for 
interchange, presenters very competent 
( (no entry) ) 

Interaction of participants 

General session speakers 

Major speakers 

Speakers; Butts, Jackson 

Some of the presentations in workshops 
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CATEGORIZATION OF PARTICIPANT RESPONSES: STRONGEST POINTS 

OF THE rCETING 

Question 9b. What were the strongest points of this meeting? 

Each of the strengths is repeated below, together with all the 
comments that pertain to it, pro and con . Comments v/hich incorporate 
more than one concept may appear under more than one category. The 
doiable-letter code which appears in pcurentheses at the end of each 
identifies the questionnaire from which the comment was abstracted. 
All questionnadres are available for inspection in the office of the 
Citizen Education Staffs U,S, Office of Education, or from the evallJators, 

Quality of the Presenters 

Outstanding speakers. (A5) 

Presentations by main speakers and activity session presenters, (AP) 
Dr. Coles address. (AH) 

The speakers at the general sessions were outstanding. (AI) 

The main speakers. (AK) 

Good speakers. (AM) 

Some of the major speakers. (AN) 

Some of the presenters at **Special Activities." (AN) 
Quality of presenters .... (AO) 
Good speakers. (AP) 
Good speakers. (AW) 

General speakers ^ motivation and information. (AX) 
Several of the speakers were outstanding. (BC) 
The addresses. (BE) 
The speakers. (BP) 
Speeches. (BK) 

Jesse Jackson, Badi Poster, Rob't Coles, Freeman Butts (breakfast 

Tuesday morning) . BM 
General Session presentations. (BR) 
A few speakers and presenters. (BS) 
Certain presentations, eg. Butts. (BT) 

The speakers (except Abby and Buckley) , particularly Secretary Mathews 

and Rev. Jesse Jackson. (CB) 
The truly excellent speaJjfcerisi. (CC) 
Several lecturers-- Coles , Jackson, Mehlinger. (CP) 
Some of the general session speakers. (CH) 
Rev. Jesse Jackson. (CI) 
"Some" of the speakers. (CK) 
Special Speakers. (CO) 
The major speakers. (CP) 

Some excellent speakers who really laid it on the line. (CQ) 
General Sessions - speeches. (CR) 
Talks. (CT) 

Some speakers - Coles and Poster and Scriven. (CV) 
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Question 9b • 



Speakers • (Cl^) 
Excellent speakers. (CY) 

Many of the speakers at general sessions were fine. (DA) 

Main speakers. (DB) 

Excellent array of speakers. (DC) 

The main speakers. (DG) 

• • • presenters very competent. (EA) 

General session speakers. (ED) 

Major speakers. (EE) 

Speakers: Butts, J^ackson. (EF) 

Interaction amony Petrticipantg 

Dialogue with participants. (AA) 

Opportunity for discussions. (AB) 

A good dialogue with large overview. (AE) 

The sharing of ideas and activities already working toward the 

conference goal. (AG) 
The brainstorming discussions in the work sessions. (AH) 
Contact with other educators and authors in this field. (AR) 
Opportunity to meet others interested in this problem. (AT) 
Discussion. (AV) 
Corridor talk. (BA) 
Good discussion. (BB) 

The interaction with people across the country. (BE) 

Meeting people active in rxy specific area of interest - law-related 

education. (BI) . 
Group discussions. (BK) 

Opportunity to meet with people with diverse viewpoints and experiences 

relating to citizenship education. (BL) 
Opportunities for exchange of ideas in the work sessions. (BR) 
The interaction of the various sectors of society was extremely 

important. (OA) 

The exchange between the participants representing so broad a spectrum 
(CO 

Some very interesting and talented people that 1 met. (CP) 
Interaction with others. (CK) 
Meeting new peqple. (CL) 
Sharing ideas. (CL) - 

Interaction within small group when people began to trust each other 

and really shared expertise. (CN) 
Interaction with others. (CO) 
Sharing concerns and successes. ICQ) 



•a) 
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Question 9b. 



Interactions with other participants. (CW) 

Brainstorming and exchange of ideas during work sessions (may not 

have been true in other work groups) • (DH) 
Special activity groi5)S - allowed most opportunity for interchange . 

(EA) 

Interaction of participants, (EG) 
Special Activities 
Special activities (AC) 

Some of the presenters at '^Speciail Activities." (AN) 
"Special Activity" presentations and discussions. (AR) 
Special Activity Sessions. (AT) 
Good activity groins. (BB) 

The sessions on ethics education were exceptional. 
The special activity (A) . (BF) 
Special Activities on Ethics. (BH) 
Special activities. (BP) 
Special activity groups. (BR) 

The special groups were very informative, especially for one not in 

education. (CI) 
Special Activity sessions. (CK) 
Special interest meetings. (CM) 

Special Activity Groups - well-prepared and presented. (CV) 
Interest groixps. (CW) 

Attention to presentations of specific programs in small groups; e.g 
Fred Newmann*s project, Gillespie et al "Conparing Political 

Experiences." (OA) 
Special interest group presentations. (DC) 

Special activity groups - allowed most opportunity for interchange, 
presenters very competent* (EA) 

Diversity and Qu&lity of Par ticipants 

People paxtlcipating. (AJ) 

The "mix" of people represented. (AN) 

Quality of . . . partioipanf;s. (AO) 

Variety and scope of expwcls© Avail^ible. (AS) 

People I met. (AZ) 

Diverse groups. (BA) 

Wide variety of opinions. (!? 

Good "expertis" available. (• 

Broad representation. ^HG) 

Participants . (BN) 
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Liked the selected attendance and how they got to business of 

conference. (BO) 
. . . participants representing so broad a spectrum. (CC) 
Participants . (CE) 
The mix of people. (CH) 
Input from diversified sectors. (C3N) 
The spread of peucticlpemta from aurouoid the nation. (CP) 
The various groups represented. (CR) 

Broad basis for participation outstanding approach at this time. (CU) 
Paurt:icipantsl ! I Their willingness and interest in working towsurds 

Improved perceptions/attitudes about C.E. (CV) 
The meeting brought together people from xaany sectors of society not 

just the universities and public schools. (DF) 

Opportunities for Exchange of Information 

Hearing what others were doing. (AC) 
Many viewpoints expressed. (AD) 
• • • large overview. (A£) 

The sharing of ideas and activities already working toward the 

conference goal. (AG) 
Availability of speeches. (2VN) 
Challenging thoughts. (BD) 
Learned so muchl (BO) 

Opportunities for exchange of ideas in the work sessions. (BR) 
The materials shared* (CK) 

Sincere desire by HEW officials to study the problem and listen 

to suggestions from conference participants. (CU) 
Good coverage of the topic. .(CZ) 

Presentation and acceptance of diversity of opinion. (DD) 
Dissemination of information on current programs. (DD) 
Awareness developed between various sectors of society. (DH) 



Work Group Sessions 

The brainstorming discussions in the work sessions. (AH) 

Work sessions^ small groups. (AO) 

Organized and wall developed group discussions. (AP) 

Dis Class ion. (AV) 

Good group leaders. (AW) 

Good discussion, (BB) 

Rap sessions. (BG) 

Our group leaders ability to deal w/ a roorly planned and devised 

meeting. (BJ) 
Group discussions. (BK) 
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Potentially - the work groups. (BS) 

The work groups. We were able to relate our feelings, plus we 
had a good leader - George Lowe w/ the U.S. Office of Ed. (CJ) 

Interaction within small groiip when people began to trust each other 
and resOly shsLred expertise. (CN) 

Discussion groups. (CO) 

The small group organization, both special and work groups. (CP) 
Work groups - discussions, (CS) 
• . . good discussions. (CX) 

Vfy workshop was very good - Pacillitator excellent- (CY) 
Grotip discussions. (dB) 

Initial confrontation of problems by citizens. (DE) 
Work group sessions. (DG) 

Brainstorming and exchange of ideas during work sessions (may not have 

been true in othor work groups). (DH) 
Some of the presentations in workshops. (EG) 

Conference Organization 

Good organization. (j\M) 

Highly planned attempt to get all participants to react on an equal • 
-basis. (AU) 

Lots of Tfork in 3 1/2 days. (AW) 

Varied type of program throughout day. (AX) 

Breadth. (AY) 

Getting the "ball rolling." (AZ) 
Well programed. (BO) 

Getting the commtuilty and parents involved. (CG) 
Full scheduling of time. (CH) 

The tight schedule which forced people to stay with the task. (CP) 
Concentrated attention (tight schedule). 

to a variety of approaches to citizen education 

with some topflight addresses. (CX) 
Well organized presentation of the need for action. (DD) 
Future publicity {can realistically claim ik hou^ woi:k-days. (DE) 

Sub J ect Matter 

The topics chosen. (AL) 

Conqplex area that needs to be worked on by all sectors of society, (j 

Topic - Citizenship Education. (BQ) 

Critical issue topic (Citizen Education). (CO) 

The education of our children. (CG) 
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Finding myself not alone in thinking citizenship is of a highest 
priority. (CQ) 

Superficial identification of problems on citizen education. (DE) 

Other Strenf^ths (not categorized) 

The pre-meeting questionnaire. (AL) 

Obvious commitment of many to the major task. (AT) 

Good input. (BB) 

The fa-t that the meeting vas called. (BL) 

I don't have strong or weak points at this time, but there are some. (CD) 
Renewed committment and inspiration, (CK) 

EmphELsis and recognition that it is broader than school problem. (DD) 
In addition, by the very fact of having taken place, the meeting 
called attention to the need to revitalize citizen education. (DF) 
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